File:  [gforth] / gforth / prims2x.fs
Revision 1.83: download - view: text, annotated - select for diffs
Sat Feb 24 13:44:39 2001 UTC (23 years ago) by anton
Branches: MAIN
CVS tags: HEAD
added C and primitive support for peeophole optimization

    1: \ converts primitives to, e.g., C code 
    2: 
    3: \ Copyright (C) 1995,1996,1997,1998,2000 Free Software Foundation, Inc.
    4: 
    5: \ This file is part of Gforth.
    6: 
    7: \ Gforth is free software; you can redistribute it and/or
    8: \ modify it under the terms of the GNU General Public License
    9: \ as published by the Free Software Foundation; either version 2
   10: \ of the License, or (at your option) any later version.
   11: 
   12: \ This program is distributed in the hope that it will be useful,
   13: \ but WITHOUT ANY WARRANTY; without even the implied warranty of
   14: \ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
   15: \ GNU General Public License for more details.
   16: 
   17: \ You should have received a copy of the GNU General Public License
   18: \ along with this program; if not, write to the Free Software
   19: \ Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA 02111, USA.
   20: 
   21: 
   22: \ This is not very nice (hard limits, no checking, assumes 1 chars = 1).
   23: \ And it grew even worse when it aged.
   24: 
   25: \ Optimizations:
   26: \ superfluous stores are removed. GCC removes the superfluous loads by itself
   27: \ TOS and FTOS can be kept in register( variable)s.
   28: \ 
   29: \ Problems:
   30: \ The TOS optimization is somewhat hairy. The problems by example:
   31: \ 1) dup ( w -- w w ): w=TOS; sp-=1; sp[1]=w; TOS=w;
   32: \    The store is not superfluous although the earlier opt. would think so
   33: \    Alternatively:    sp[0]=TOS; w=TOS; sp-=1; TOS=w;
   34: \ 2) ( -- .. ): sp[0] = TOS; ... /* This additional store is necessary */
   35: \ 3) ( .. -- ): ... TOS = sp[0]; /* as well as this load */
   36: \ 4) ( -- ): /* but here they are unnecessary */
   37: \ 5) Words that call NEXT themselves have to be done very carefully.
   38: \
   39: \ To do:
   40: \ add the store optimization for doubles
   41: \ regarding problem 1 above: It would be better (for over) to implement
   42: \ 	the alternative
   43: \ store optimization for combined instructions.
   44: \ eliminate stack-cast (no longer used)
   45: 
   46: \ Design Uglyness:
   47: 
   48: \ - global state (values, variables) in connection with combined instructions.
   49: 
   50: \ - index computation is different for instruction-stream and the
   51: \ stacks; there are two mechanisms for dealing with that
   52: \ (stack-in-index-xt and a test for stack==instruction-stream); there
   53: \ should be only one.
   54: 
   55: warnings off
   56: 
   57: [IFUNDEF] vocabulary	\ we are executed just with kernel image
   58: 			\ load the rest that is needed
   59: 			\ (require fails because this file is needed from a
   60: 			\ different directory with the wordlibraries)
   61: include ./search.fs			
   62: include ./extend.fs
   63: [THEN]
   64: include ./stuff.fs
   65: 
   66: [IFUNDEF] environment?
   67: include ./environ.fs
   68: [THEN]
   69: 
   70: : struct% struct ; \ struct is redefined in gray
   71: 
   72: include ./gray.fs
   73: 
   74: 32 constant max-effect \ number of things on one side of a stack effect
   75: 4 constant max-stacks  \ the max. number of stacks (including inst-stream).
   76: 255 constant maxchar
   77: maxchar 1+ constant eof-char
   78: #tab constant tab-char
   79: #lf constant nl-char
   80: 
   81: variable rawinput \ pointer to next character to be scanned
   82: variable endrawinput \ pointer to the end of the input (the char after the last)
   83: variable cookedinput \ pointer to the next char to be parsed
   84: variable line \ line number of char pointed to by input
   85: variable line-start \ pointer to start of current line (for error messages)
   86: 0 line !
   87: 2variable filename \ filename of original input file
   88: 0 0 filename 2!
   89: 2variable f-comment
   90: 0 0 f-comment 2!
   91: variable skipsynclines \ are sync lines ("#line ...") invisible to the parser?
   92: skipsynclines on 
   93: 
   94: : th ( addr1 n -- addr2 )
   95:     cells + ;
   96: 
   97: : holds ( addr u -- )
   98:     \ like HOLD, but for a string
   99:     tuck + swap 0 +do
  100: 	1- dup c@ hold
  101:     loop
  102:     drop ;
  103: 
  104: : insert-wordlist { c-addr u wordlist xt -- }
  105:     \ adds name "addr u" to wordlist using defining word xt
  106:     \ xt may cause additional stack effects
  107:     get-current >r wordlist set-current
  108:     c-addr u nextname xt execute
  109:     r> set-current ;
  110: 
  111: : start ( -- addr )
  112:  cookedinput @ ;
  113: 
  114: : end ( addr -- addr u )
  115:  cookedinput @ over - ;
  116: 
  117: : print-error-line ( -- )
  118:     \ print the current line and position
  119:     line-start @ endrawinput @ over - 2dup nl-char scan drop nip ( start end )
  120:     over - type cr
  121:     line-start @ rawinput @ over - typewhite ." ^" cr ;
  122: 
  123: : ?print-error { f addr u -- }
  124:     f ?not? if
  125: 	outfile-id >r try
  126: 	    stderr to outfile-id
  127: 	    filename 2@ type ." :" line @ 0 .r ." : " addr u type cr
  128: 	    print-error-line
  129: 	    0
  130: 	recover endtry
  131: 	r> to outfile-id throw
  132: 	abort
  133:     endif ;
  134: 
  135: : quote ( -- )
  136:     [char] " emit ;
  137: 
  138: variable output          \ xt ( -- ) of output word for simple primitives
  139: variable output-combined \ xt ( -- ) of output word for combined primitives
  140: 
  141: struct%
  142:     cell%    field stack-number \ the number of this stack
  143:     cell% 2* field stack-pointer \ stackpointer name
  144:     cell%    field stack-type \ name for default type of stack items
  145:     cell% 2* field stack-cast \ cast string for assignments to stack elements
  146:     cell%    field stack-in-index-xt \ ( in-size item -- in-index )
  147: end-struct stack%
  148: 
  149: struct%
  150:  cell% 2* field item-name   \ name, excluding stack prefixes
  151:  cell%    field item-stack  \ descriptor for the stack used, 0 is default
  152:  cell%    field item-type   \ descriptor for the item type
  153:  cell%    field item-offset \ offset in stack items, 0 for the deepest element
  154:  cell%	  field item-first  \ true if this is the first occurence of the item
  155: end-struct item%
  156: 
  157: struct%
  158:     cell% 2* field type-c-name
  159:     cell%    field type-stack \ default stack
  160:     cell%    field type-size  \ size of type in stack items
  161:     cell%    field type-fetch \ xt of fetch code generator ( item -- )
  162:     cell%    field type-store \ xt of store code generator ( item -- )
  163: end-struct type%
  164: 
  165: variable next-stack-number 0 next-stack-number !
  166: create stacks max-stacks cells allot \ array of stacks
  167: 
  168: : stack-in-index ( in-size item -- in-index )
  169:     item-offset @ - 1- ;
  170: 
  171: : inst-in-index ( in-size item -- in-index )
  172:     nip dup item-offset @ swap item-type @ type-size @ + 1- ;
  173: 
  174: : make-stack ( addr-ptr u1 type addr-cast u2 "stack-name" -- )
  175:     create stack% %allot >r
  176:     r@ stacks next-stack-number @ th !
  177:     next-stack-number @ r@ stack-number !  1 next-stack-number +!
  178:     save-mem r@ stack-cast 2!
  179:     r@ stack-type !
  180:     save-mem r@ stack-pointer 2! 
  181:     ['] stack-in-index r> stack-in-index-xt ! ;
  182: 
  183: \ stack items
  184: 
  185: : init-item ( addr u addr1 -- )
  186:     \ initialize item at addr1 with name addr u
  187:     \ !! remove stack prefix
  188:     dup item% %size erase
  189:     item-name 2! ;
  190: 
  191: : map-items { addr end xt -- }
  192:     \ perform xt for all items in array addr...end
  193:     end addr ?do
  194: 	i xt execute
  195:     item% %size +loop ;
  196: 
  197: \ types
  198: 
  199: : print-type-prefix ( type -- )
  200:     body> >head name>string type ;
  201: 
  202: \ various variables for storing stuff of one primitive
  203: 
  204: struct%
  205:     cell% 2* field prim-name
  206:     cell% 2* field prim-wordset
  207:     cell% 2* field prim-c-name
  208:     cell% 2* field prim-doc
  209:     cell% 2* field prim-c-code
  210:     cell% 2* field prim-forth-code
  211:     cell% 2* field prim-stack-string
  212:     cell%    field prim-num            \ ordinal number
  213:     cell%    field prim-items-wordlist \ unique items
  214:     item% max-effect * field prim-effect-in
  215:     item% max-effect * field prim-effect-out
  216:     cell%    field prim-effect-in-end
  217:     cell%    field prim-effect-out-end
  218:     cell% max-stacks * field prim-stacks-in  \ number of in items per stack
  219:     cell% max-stacks * field prim-stacks-out \ number of out items per stack
  220: end-struct prim%
  221: 
  222: : make-prim ( -- prim )
  223:     prim% %alloc { p }
  224:     s" " p prim-doc 2! s" " p prim-forth-code 2! s" " p prim-wordset 2!
  225:     p ;
  226: 
  227: 0 value prim     \ in combined prims either combined or a part
  228: 0 value combined \ in combined prims the combined prim
  229: variable in-part \ true if processing a part
  230:  in-part off
  231: 
  232: 1000 constant max-combined
  233: create combined-prims max-combined cells allot
  234: variable num-combined
  235: 
  236: table constant combinations
  237:   \ the keys are the sequences of pointers to primitives
  238: 
  239: create current-depth max-stacks cells allot
  240: create max-depth     max-stacks cells allot
  241: create min-depth     max-stacks cells allot
  242: 
  243: wordlist constant primitives
  244: 
  245: : create-prim ( prim -- )
  246:     dup prim-name 2@ primitives ['] constant insert-wordlist ;
  247: 
  248: : stack-in ( stack -- addr )
  249:     \ address of number of stack items in effect in
  250:     stack-number @ cells prim prim-stacks-in + ;
  251: 
  252: : stack-out ( stack -- addr )
  253:     \ address of number of stack items in effect out
  254:     stack-number @ cells prim prim-stacks-out + ;
  255: 
  256: \ global vars
  257: variable c-line
  258: 2variable c-filename
  259: variable name-line
  260: 2variable name-filename
  261: 2variable last-name-filename
  262: Variable function-number 0 function-number !
  263: 
  264: \ a few more set ops
  265: 
  266: : bit-equivalent ( w1 w2 -- w3 )
  267:  xor invert ;
  268: 
  269: : complement ( set1 -- set2 )
  270:  empty ['] bit-equivalent binary-set-operation ;
  271: 
  272: \ stack access stuff
  273: 
  274: : normal-stack-access ( n stack -- )
  275:     stack-pointer 2@ type
  276:     dup
  277:     if
  278: 	." [" 0 .r ." ]"
  279:     else
  280: 	drop ." TOS"
  281:     endif ;
  282: 
  283: \ forward declaration for inst-stream (breaks cycle in definitions)
  284: defer inst-stream-f ( -- stack )
  285: 
  286: : part-stack-access { n stack -- }
  287:     \ print _<stack><x>, x=inst-stream? n : maxdepth-currentdepth-n-1
  288:     ." _" stack stack-pointer 2@ type
  289:     stack stack-number @ { stack# }
  290:     current-depth stack# th @ n + { access-depth }
  291:     stack inst-stream-f = if
  292: 	access-depth
  293:     else
  294: 	combined prim-stacks-in stack# th @
  295: 	assert( dup max-depth stack# th @ = )
  296: 	access-depth - 1-
  297:     endif
  298:     0 .r ;
  299: 
  300: : stack-access ( n stack -- )
  301:     \ print a stack access at index n of stack
  302:     in-part @ if
  303: 	part-stack-access
  304:     else
  305: 	normal-stack-access
  306:     endif ;
  307: 
  308: : item-in-index { item -- n }
  309:     \ n is the index of item (in the in-effect)
  310:     item item-stack @ dup >r stack-in @ ( in-size r:stack )
  311:     item r> stack-in-index-xt @ execute ;
  312: 
  313: : item-stack-type-name ( item -- addr u )
  314:     item-stack @ stack-type @ type-c-name 2@ ;
  315: 
  316: : fetch-single ( item -- )
  317:  \ fetch a single stack item from its stack
  318:  >r
  319:  r@ item-name 2@ type
  320:  ."  = vm_" r@ item-stack-type-name type
  321:  ." 2" r@ item-type @ print-type-prefix ." ("
  322:  r@ item-in-index r@ item-stack @ stack-access
  323:  ." );" cr
  324:  rdrop ; 
  325: 
  326: : fetch-double ( item -- )
  327:  \ fetch a double stack item from its stack
  328:  >r
  329:  ." vm_two"
  330:  r@ item-stack-type-name type ." 2"
  331:  r@ item-type @ print-type-prefix ." ("
  332:  r@ item-name 2@ type ." , "
  333:  r@ item-in-index r@ item-stack @ 2dup ." (Cell)" stack-access
  334:  ." , "                      -1 under+ ." (Cell)" stack-access
  335:  ." );" cr
  336:  rdrop ;
  337: 
  338: : same-as-in? ( item -- f )
  339:  \ f is true iff the offset and stack of item is the same as on input
  340:  >r
  341:  r@ item-first @ if
  342:      rdrop false exit
  343:  endif
  344:  r@ item-name 2@ prim prim-items-wordlist @ search-wordlist 0= abort" bug"
  345:  execute @
  346:  dup r@ =
  347:  if \ item first appeared in output
  348:    drop false
  349:  else
  350:    dup  item-stack  @ r@ item-stack  @ = 
  351:    swap item-offset @ r@ item-offset @ = and
  352:  endif
  353:  rdrop ;
  354: 
  355: : item-out-index ( item -- n )
  356:     \ n is the index of item (in the in-effect)
  357:     >r r@ item-stack @ stack-out @ r> item-offset @ - 1- ;
  358: 
  359: : really-store-single ( item -- )
  360:  >r
  361:  r@ item-out-index r@ item-stack @ stack-access ."  = vm_"
  362:  r@ item-type @ print-type-prefix ." 2"
  363:  r@ item-stack-type-name type ." ("
  364:  r@ item-name 2@ type ." );"
  365:  rdrop ;
  366: 
  367: : store-single ( item -- )
  368:  >r
  369:  r@ same-as-in?
  370:  if
  371:    r@ item-in-index 0= r@ item-out-index 0= xor
  372:    if
  373:        ." IF_" r@ item-stack @ stack-pointer 2@ type
  374:        ." TOS(" r@ really-store-single ." );" cr
  375:    endif
  376:  else
  377:    r@ really-store-single cr
  378:  endif
  379:  rdrop ;
  380: 
  381: : store-double ( item -- )
  382: \ !! store optimization is not performed, because it is not yet needed
  383:  >r
  384:  ." vm_"
  385:  r@ item-type @ print-type-prefix ." 2two"
  386:  r@ item-stack-type-name type ." ("
  387:  r@ item-name 2@ type ." , "
  388:  r@ item-out-index r@ item-stack @ 2dup stack-access
  389:  ." , "                       -1 under+ stack-access
  390:  ." );" cr
  391:  rdrop ;
  392: 
  393: : single ( -- xt1 xt2 n )
  394:     ['] fetch-single ['] store-single 1 ;
  395: 
  396: : double ( -- xt1 xt2 n )
  397:     ['] fetch-double ['] store-double 2 ;
  398: 
  399: : s, ( addr u -- )
  400: \ allocate a string
  401:  here swap dup allot move ;
  402: 
  403: wordlist constant prefixes
  404: 
  405: : declare ( addr "name" -- )
  406: \ remember that there is a stack item at addr called name
  407:  create , ;
  408: 
  409: : !default ( w addr -- )
  410:     dup @ if
  411: 	2drop \ leave nonzero alone
  412:     else
  413: 	!
  414:     endif ;
  415: 
  416: : create-type { addr u xt1 xt2 n stack -- } ( "prefix" -- )
  417:     \ describes a type
  418:     \ addr u specifies the C type name
  419:     \ stack effect entries of the type start with prefix
  420:     create type% %allot >r
  421:     addr u save-mem r@ type-c-name 2!
  422:     xt1   r@ type-fetch !
  423:     xt2   r@ type-store !
  424:     n     r@ type-size !
  425:     stack r@ type-stack !
  426:     rdrop ;
  427: 
  428: : type-prefix ( xt1 xt2 n stack "prefix" -- )
  429:     create-type
  430: does> ( item -- )
  431:     \ initialize item
  432:     { item typ }
  433:     typ item item-type !
  434:     typ type-stack @ item item-stack !default
  435:     item item-name 2@ prim prim-items-wordlist @ search-wordlist 0= if
  436: 	item item-name 2@ nextname item declare
  437: 	item item-first on
  438: 	\ typ type-c-name 2@ type space type  ." ;" cr
  439:     else
  440: 	drop
  441: 	item item-first off
  442:     endif ;
  443: 
  444: : execute-prefix ( item addr1 u1 -- )
  445:     \ execute the word ( item -- ) associated with the longest prefix
  446:     \ of addr1 u1
  447:     0 swap ?do
  448: 	dup i prefixes search-wordlist
  449: 	if \ ok, we have the type ( item addr1 xt )
  450: 	    nip execute
  451: 	    UNLOOP EXIT
  452: 	endif
  453: 	-1 s+loop
  454:     \ we did not find a type, abort
  455:     false s" unknown prefix" ?print-error ;
  456: 
  457: : declaration ( item -- )
  458:     dup item-name 2@ execute-prefix ;
  459: 
  460: : declaration-list ( addr1 addr2 -- )
  461:     ['] declaration map-items ;
  462: 
  463: : declarations ( -- )
  464:  wordlist dup prim prim-items-wordlist ! set-current
  465:  prim prim-effect-in prim prim-effect-in-end @ declaration-list
  466:  prim prim-effect-out prim prim-effect-out-end @ declaration-list ;
  467: 
  468: : print-declaration { item -- }
  469:     item item-first @ if
  470: 	item item-type @ type-c-name 2@ type space
  471: 	item item-name 2@ type ." ;" cr
  472:     endif ;
  473: 
  474: : print-declarations ( -- )
  475:     prim prim-effect-in  prim prim-effect-in-end  @ ['] print-declaration map-items
  476:     prim prim-effect-out prim prim-effect-out-end @ ['] print-declaration map-items ;
  477:     
  478: : stack-prefix ( stack "prefix" -- )
  479:     name tuck nextname create ( stack length ) 2,
  480: does> ( item -- )
  481:     2@ { item stack prefix-length }
  482:     item item-name 2@ prefix-length /string item item-name 2!
  483:     stack item item-stack !
  484:     item declaration ;
  485: 
  486: \ types pointed to by stacks for use in combined prims
  487: \ !! output-c-combined shouldn't use these names!
  488: s" Cell"  single 0 create-type w
  489: s" Float" single 0 create-type r
  490: 
  491: s" sp" save-mem w s" (Cell)" make-stack data-stack 
  492: s" fp" save-mem r s" "       make-stack fp-stack
  493: s" rp" save-mem w s" (Cell)" make-stack return-stack
  494: s" IP" save-mem w s" error don't use # on results" make-stack inst-stream
  495: ' inst-in-index inst-stream stack-in-index-xt !
  496: ' inst-stream <is> inst-stream-f
  497: \ !! initialize stack-in and stack-out
  498: 
  499: \ offset computation
  500: \ the leftmost (i.e. deepest) item has offset 0
  501: \ the rightmost item has the highest offset
  502: 
  503: : compute-offset { item xt -- }
  504:     \ xt specifies in/out; update stack-in/out and set item-offset
  505:     item item-type @ type-size @
  506:     item item-stack @ xt execute dup @ >r +!
  507:     r> item item-offset ! ;
  508: 
  509: : compute-offset-in ( addr1 addr2 -- )
  510:     ['] stack-in compute-offset ;
  511: 
  512: : compute-offset-out ( addr1 addr2 -- )
  513:     ['] stack-out compute-offset ;
  514: 
  515: : clear-stack { -- }
  516:     dup stack-in off stack-out off ;
  517: 
  518: : compute-offsets ( -- )
  519:     data-stack clear-stack  fp-stack clear-stack return-stack clear-stack
  520:     inst-stream clear-stack
  521:     prim prim-effect-in  prim prim-effect-in-end  @ ['] compute-offset-in  map-items
  522:     prim prim-effect-out prim prim-effect-out-end @ ['] compute-offset-out map-items
  523:     inst-stream stack-out @ 0= s" # can only be on the input side" ?print-error ;
  524: 
  525: : process-simple ( -- )
  526:     prim prim { W^ key } key cell
  527:     combinations ['] constant insert-wordlist
  528:     declarations compute-offsets
  529:     output @ execute ;
  530: 
  531: : flush-a-tos { stack -- }
  532:     stack stack-out @ 0<> stack stack-in @ 0= and
  533:     if
  534: 	." IF_" stack stack-pointer 2@ 2dup type ." TOS("
  535: 	2dup type ." [0] = " type ." TOS);" cr
  536:     endif ;
  537: 
  538: : flush-tos ( -- )
  539:     data-stack   flush-a-tos
  540:     fp-stack     flush-a-tos
  541:     return-stack flush-a-tos ;
  542: 
  543: : fill-a-tos { stack -- }
  544:     stack stack-out @ 0= stack stack-in @ 0<> and
  545:     if
  546: 	." IF_" stack stack-pointer 2@ 2dup type ." TOS("
  547: 	2dup type ." TOS = " type ." [0]);" cr
  548:     endif ;
  549: 
  550: : fill-tos ( -- )
  551:     \ !! inst-stream for prefetching?
  552:     fp-stack     fill-a-tos
  553:     data-stack   fill-a-tos
  554:     return-stack fill-a-tos ;
  555: 
  556: : fetch ( addr -- )
  557:     dup item-type @ type-fetch @ execute ;
  558: 
  559: : fetches ( -- )
  560:     prim prim-effect-in prim prim-effect-in-end @ ['] fetch map-items ;
  561: 
  562: : stack-pointer-update { stack -- }
  563:     \ stack grow downwards
  564:     stack stack-in @ stack stack-out @ -
  565:     ?dup-if \ this check is not necessary, gcc would do this for us
  566: 	stack stack-pointer 2@ type ."  += " 0 .r ." ;" cr
  567:     endif ;
  568: 
  569: : inst-pointer-update ( -- )
  570:     inst-stream stack-in @ ?dup-if
  571: 	." INC_IP(" 0 .r ." );" cr
  572:     endif ;
  573: 
  574: : stack-pointer-updates ( -- )
  575:     inst-pointer-update
  576:     data-stack   stack-pointer-update
  577:     fp-stack     stack-pointer-update
  578:     return-stack stack-pointer-update ;
  579: 
  580: : store ( item -- )
  581: \ f is true if the item should be stored
  582: \ f is false if the store is probably not necessary
  583:  dup item-type @ type-store @ execute ;
  584: 
  585: : stores ( -- )
  586:     prim prim-effect-out prim prim-effect-out-end @ ['] store map-items ;
  587: 
  588: : output-c-tail ( -- )
  589:     \ the final part of the generated C code
  590:     ." NEXT_P1;" cr
  591:     stores
  592:     fill-tos
  593:     ." NEXT_P2;" cr ;
  594: 
  595: : type-c ( c-addr u -- )
  596:     \ like TYPE, but replaces "TAIL;" with tail code
  597:     begin ( c-addr1 u1 )
  598: 	2dup s" TAIL;" search
  599:     while ( c-addr1 u1 c-addr3 u3 )
  600: 	2dup 2>r drop nip over - type
  601: 	output-c-tail
  602: 	2r> 5 /string
  603: 	\ !! resync #line missing
  604:     repeat
  605:     2drop type ;
  606: 
  607: : print-debug-arg { item -- }
  608:     ." fputs(" quote space item item-name 2@ type ." =" quote ." , vm_out); "
  609:     ." printarg_" item item-type @ print-type-prefix
  610:     ." (" item item-name 2@ type ." );" cr ;
  611:     
  612: : print-debug-args ( -- )
  613:     ." #ifdef VM_DEBUG" cr
  614:     ." if (vm_debug) {" cr
  615:     prim prim-effect-in prim prim-effect-in-end @ ['] print-debug-arg map-items
  616:     ." fputc('\n', vm_out);" cr
  617:     ." }" cr
  618:     ." #endif" cr ;
  619: 
  620: : print-entry ( -- )
  621:     ." I_" prim prim-c-name 2@ type ." :" ;
  622:     
  623: : output-c ( -- ) 
  624:  print-entry ."  /* " prim prim-name 2@ type ."  ( " prim prim-stack-string 2@ type ." ) */" cr
  625:  ." /* " prim prim-doc 2@ type ."  */" cr
  626:  ." NAME(" quote prim prim-name 2@ type quote ." )" cr \ debugging
  627:  ." {" cr
  628:  ." DEF_CA" cr
  629:  print-declarations
  630:  ." NEXT_P0;" cr
  631:  flush-tos
  632:  fetches
  633:  print-debug-args
  634:  stack-pointer-updates
  635:  ." {" cr
  636:  ." #line " c-line @ . quote c-filename 2@ type quote cr
  637:  prim prim-c-code 2@ type-c
  638:  ." }" cr
  639:  output-c-tail
  640:  ." }" cr
  641:  cr
  642: ;
  643: 
  644: : disasm-arg { item -- }
  645:     item item-stack @ inst-stream = if
  646: 	."   fputc(' ', vm_out); "
  647: 	." printarg_" item item-type @ print-type-prefix
  648: 	." ((" item item-type @ type-c-name 2@ type ." )"
  649: 	." ip[" item item-offset @ 1+ 0 .r ." ]);" cr
  650:     endif ;
  651: 
  652: : disasm-args ( -- )
  653:     prim prim-effect-in prim prim-effect-in-end @ ['] disasm-arg map-items ;
  654: 
  655: : output-disasm ( -- )
  656:     \ generate code for disassembling VM instructions
  657:     ." if (ip[0] == prim[" function-number @ 0 .r ." ]) {" cr
  658:     ."   fputs(" quote prim prim-name 2@ type quote ." , vm_out);" cr
  659:     disasm-args
  660:     ."   ip += " inst-stream stack-in @ 1+ 0 .r ." ;" cr
  661:     ." } else " ;
  662: 
  663: : gen-arg-parm { item -- }
  664:     item item-stack @ inst-stream = if
  665: 	." , " item item-type @ type-c-name 2@ type space
  666: 	item item-name 2@ type
  667:     endif ;
  668: 
  669: : gen-args-parm ( -- )
  670:     prim prim-effect-in prim prim-effect-in-end @ ['] gen-arg-parm map-items ;
  671: 
  672: : gen-arg-gen { item -- }
  673:     item item-stack @ inst-stream = if
  674: 	."   genarg_" item item-type @ print-type-prefix
  675:         ." (ctp, " item item-name 2@ type ." );" cr
  676:     endif ;
  677: 
  678: : gen-args-gen ( -- )
  679:     prim prim-effect-in prim prim-effect-in-end @ ['] gen-arg-gen map-items ;
  680: 
  681: : output-gen ( -- )
  682:     \ generate C code for generating VM instructions
  683:     ." void gen_" prim prim-c-name 2@ type ." (Inst **ctp" gen-args-parm ." )" cr
  684:     ." {" cr
  685:     ."   gen_inst(ctp, vm_prim[" function-number @ 0 .r ." ]);" cr
  686:     gen-args-gen
  687:     ." }" cr ;
  688: 
  689: : stack-used? { stack -- f }
  690:     stack stack-in @ stack stack-out @ or 0<> ;
  691: 
  692: : output-funclabel ( -- )
  693:   ." &I_" prim prim-c-name 2@ type ." ," cr ;
  694: 
  695: : output-forthname ( -- )
  696:   '" emit prim prim-name 2@ type '" emit ." ," cr ;
  697: 
  698: : output-c-func ( -- )
  699: \ used for word libraries
  700:     ." Cell * I_" prim prim-c-name 2@ type ." (Cell *SP, Cell **FP)      /* " prim prim-name 2@ type
  701:     ."  ( " prim prim-stack-string 2@ type ."  ) */" cr
  702:     ." /* " prim prim-doc 2@ type ."  */" cr
  703:     ." NAME(" quote prim prim-name 2@ type quote ." )" cr
  704:     \ debugging
  705:     ." {" cr
  706:     print-declarations
  707:     inst-stream  stack-used? IF ." Cell *ip=IP;" cr THEN
  708:     data-stack   stack-used? IF ." Cell *sp=SP;" cr THEN
  709:     fp-stack     stack-used? IF ." Cell *fp=*FP;" cr THEN
  710:     return-stack stack-used? IF ." Cell *rp=*RP;" cr THEN
  711:     flush-tos
  712:     fetches
  713:     stack-pointer-updates
  714:     fp-stack   stack-used? IF ." *FP=fp;" cr THEN
  715:     ." {" cr
  716:     ." #line " c-line @ . quote c-filename 2@ type quote cr
  717:     prim prim-c-code 2@ type
  718:     ." }" cr
  719:     stores
  720:     fill-tos
  721:     ." return (sp);" cr
  722:     ." }" cr
  723:     cr ;
  724: 
  725: : output-label ( -- )  
  726:     ." (Label)&&I_" prim prim-c-name 2@ type ." ," cr ;
  727: 
  728: : output-alias ( -- ) 
  729:     ( primitive-number @ . ." alias " ) ." Primitive " prim prim-name 2@ type cr ;
  730: 
  731: : output-forth ( -- )  
  732:     prim prim-forth-code @ 0=
  733:     IF    	\ output-alias
  734: 	\ this is bad for ec: an alias is compiled if tho word does not exist!
  735: 	\ JAW
  736:     ELSE  ." : " prim prim-name 2@ type ."   ( "
  737: 	prim prim-stack-string 2@ type ." )" cr
  738: 	prim prim-forth-code 2@ type cr
  739:     THEN ;
  740: 
  741: : output-tag-file ( -- )
  742:     name-filename 2@ last-name-filename 2@ compare if
  743: 	name-filename 2@ last-name-filename 2!
  744: 	#ff emit cr
  745: 	name-filename 2@ type
  746: 	." ,0" cr
  747:     endif ;
  748: 
  749: : output-tag ( -- )
  750:     output-tag-file
  751:     prim prim-name 2@ 1+ type
  752:     127 emit
  753:     space prim prim-name 2@ type space
  754:     1 emit
  755:     name-line @ 0 .r
  756:     ." ,0" cr ;
  757: 
  758: [IFDEF] documentation
  759: : register-doc ( -- )
  760:     prim prim-name 2@ documentation ['] create insert-wordlist
  761:     prim prim-name 2@ 2,
  762:     prim prim-stack-string 2@ condition-stack-effect 2,
  763:     prim prim-wordset 2@ 2,
  764:     prim prim-c-name 2@ condition-pronounciation 2,
  765:     prim prim-doc 2@ 2, ;
  766: [THEN]
  767: 
  768: 
  769: \ combining instructions
  770: 
  771: \ The input should look like this:
  772: 
  773: \ lit_+ = lit +
  774: 
  775: \ The output should look like this:
  776: 
  777: \  I_lit_+:
  778: \  {
  779: \  DEF_CA
  780: \  Cell _x_ip0;
  781: \  Cell _x_sp0;
  782: \  Cell _x_sp1;
  783: \  NEXT_P0;
  784: \  _x_ip0 = (Cell) IPTOS;
  785: \  _x_sp0 = (Cell) spTOS;
  786: \  INC_IP(1);
  787: \  /* sp += 0; */
  788: \  /* lit ( #w -- w ) */
  789: \  /*  */
  790: \  NAME("lit")
  791: \  {
  792: \  Cell w;
  793: \  w = (Cell) _x_ip0;
  794: \  #ifdef VM_DEBUG
  795: \  if (vm_debug) {
  796: \  fputs(" w=", vm_out); printarg_w (w);
  797: \  fputc('\n', vm_out);
  798: \  }
  799: \  #endif
  800: \  {
  801: \  #line 136 "./prim"
  802: \  }
  803: \  _x_sp1 = (Cell)w;
  804: \  }
  805: \  I_plus:	/* + ( n1 n2 -- n ) */
  806: \  /*  */
  807: \  NAME("+")
  808: \  {
  809: \  DEF_CA
  810: \  Cell n1;
  811: \  Cell n2;
  812: \  Cell n;
  813: \  NEXT_P0;
  814: \  n1 = (Cell) _x_sp0;
  815: \  n2 = (Cell) _x_sp1;
  816: \  #ifdef VM_DEBUG
  817: \  if (vm_debug) {
  818: \  fputs(" n1=", vm_out); printarg_n (n1);
  819: \  fputs(" n2=", vm_out); printarg_n (n2);
  820: \  fputc('\n', vm_out);
  821: \  }
  822: \  #endif
  823: \  {
  824: \  #line 516 "./prim"
  825: \  n = n1+n2;
  826: \  }
  827: \  NEXT_P1;
  828: \  _x_sp0 = (Cell)n;
  829: \  NEXT_P2;
  830: \  }
  831: \  NEXT_P1;
  832: \  spTOS = (Cell)_x_sp0;
  833: \  NEXT_P2;
  834: 
  835: : init-combined ( -- )
  836:     prim to combined
  837:     0 num-combined !
  838:     current-depth max-stacks cells erase
  839:     max-depth     max-stacks cells erase
  840:     min-depth     max-stacks cells erase
  841:     prim prim-effect-in  prim prim-effect-in-end  !
  842:     prim prim-effect-out prim prim-effect-out-end ! ;
  843: 
  844: : max! ( n addr -- )
  845:     tuck @ max swap ! ;
  846: 
  847: : min! ( n addr -- )
  848:     tuck @ min swap ! ;
  849: 
  850: : add-depths { p -- }
  851:     \ combine stack effect of p with *-depths
  852:     max-stacks 0 ?do
  853: 	current-depth i th @
  854: 	p prim-stacks-in  i th @ +
  855: 	dup max-depth i th max!
  856: 	p prim-stacks-out i th @ -
  857: 	dup min-depth i th min!
  858: 	current-depth i th !
  859:     loop ;
  860: 
  861: : add-prim ( addr u -- )
  862:     \ add primitive given by "addr u" to combined-prims
  863:     primitives search-wordlist s" unknown primitive" ?print-error
  864:     execute { p }
  865:     p combined-prims num-combined @ th !
  866:     1 num-combined +!
  867:     p add-depths ;
  868: 
  869: : compute-effects { q -- }
  870:     \ compute the stack effects of q from the depths
  871:     max-stacks 0 ?do
  872: 	max-depth i th @ dup
  873: 	q prim-stacks-in i th !
  874: 	current-depth i th @ -
  875: 	q prim-stacks-out i th !
  876:     loop ;
  877: 
  878: : make-effect-items { stack# items effect-endp -- }
  879:     \ effect-endp points to a pointer to the end of the current item-array
  880:     \ and has to be updated
  881:     stacks stack# th @ { stack }
  882:     items 0 +do
  883: 	effect-endp @ { item }
  884: 	i 0 <# #s stack stack-pointer 2@ holds [char] _ hold #> save-mem
  885: 	item item-name 2!
  886: 	stack item item-stack !
  887: 	stack stack-type @ item item-type !
  888: 	i item item-offset !
  889: 	item item-first on
  890: 	item% %size effect-endp +!
  891:     loop ;
  892: 
  893: : init-effects { q -- }
  894:     \ initialize effects field for FETCHES and STORES
  895:     max-stacks 0 ?do
  896: 	i q prim-stacks-in  i th @ q prim-effect-in-end  make-effect-items
  897: 	i q prim-stacks-out i th @ q prim-effect-out-end make-effect-items
  898:     loop ;
  899: 
  900: : process-combined ( -- )
  901:     combined combined-prims num-combined @ cells
  902:     combinations ['] constant insert-wordlist
  903:     prim compute-effects
  904:     prim init-effects
  905:     output-combined perform ;
  906: 
  907: \ C output
  908: 
  909: : print-item { n stack -- }
  910:     \ print nth stack item name
  911:     stack stack-type @ type-c-name 2@ type space
  912:     ." _" stack stack-pointer 2@ type n 0 .r ;
  913: 
  914: : print-declarations-combined ( -- )
  915:     max-stacks 0 ?do
  916: 	max-depth i th @ min-depth i th @ - 0 +do
  917: 	    i stacks j th @ print-item ." ;" cr
  918: 	loop
  919:     loop ;
  920: 
  921: : part-fetches ( -- )
  922:     fetches ;
  923: 
  924: : part-output-c-tail ( -- )
  925:     output-c-tail ;
  926: 
  927: : output-part ( p -- )
  928:     to prim
  929:     ." /* " prim prim-name 2@ type ."  ( " prim prim-stack-string 2@ type ." ) */" cr
  930:     ." NAME(" quote prim prim-name 2@ type quote ." )" cr \ debugging
  931:     ." {" cr
  932:     print-declarations
  933:     part-fetches
  934:     print-debug-args
  935:     prim add-depths \ !! right place?
  936:     ." {" cr
  937:     ." #line " c-line @ . quote c-filename 2@ type quote cr
  938:     prim prim-c-code 2@ type-c \ !! deal with TAIL
  939:     ." }" cr
  940:     part-output-c-tail
  941:     ." }" cr ;
  942: 
  943: : output-parts ( -- )
  944:     prim >r in-part on
  945:     current-depth max-stacks cells erase
  946:     num-combined @ 0 +do
  947: 	combined-prims i th @ output-part
  948:     loop
  949:     in-part off
  950:     r> to prim ;
  951: 
  952: : output-c-combined ( -- )
  953:     print-entry cr
  954:     \ debugging messages just in parts
  955:     ." {" cr
  956:     ." DEF_CA" cr
  957:     print-declarations-combined
  958:     ." NEXT_P0;" cr
  959:     flush-tos
  960:     fetches
  961:     \ print-debug-args
  962:     stack-pointer-updates
  963:     output-parts
  964:     output-c-tail
  965:     ." }" cr
  966:     cr ;
  967: 
  968: : output-forth-combined ( -- )
  969: ;
  970: 
  971: 
  972: \ peephole optimization rules
  973: 
  974: \ in order for this to work as intended, shorter combinations for each
  975: \ length must be present, and the longer combinations must follow
  976: \ shorter ones (this restriction may go away in the future).
  977:   
  978: : output-peephole ( -- )
  979:     combined-prims num-combined @ 1- cells combinations search-wordlist
  980:     s" the prefix for this combination must be defined earlier" ?print-error
  981:     ." {"
  982:     execute prim-num @ 5 .r ." ,"
  983:     combined-prims num-combined @ 1- th @ prim-num @ 5 .r ." ,"
  984:     combined prim-num @ 5 .r ." }, /* "
  985:     combined prim-c-name 2@ type ."  */"
  986:     cr ;
  987: 
  988: 
  989: \ the parser
  990: 
  991: eof-char max-member \ the whole character set + EOF
  992: 
  993: : getinput ( -- n )
  994:  rawinput @ endrawinput @ =
  995:  if
  996:    eof-char
  997:  else
  998:    cookedinput @ c@
  999:  endif ;
 1000: 
 1001: :noname ( n -- )
 1002:  dup bl > if
 1003:   emit space
 1004:  else
 1005:   .
 1006:  endif ;
 1007: print-token !
 1008: 
 1009: : testchar? ( set -- f )
 1010:  getinput member? ;
 1011: ' testchar? test-vector !
 1012: 
 1013: : checksyncline ( -- )
 1014:     \ when input points to a newline, check if the next line is a
 1015:     \ sync line.  If it is, perform the appropriate actions.
 1016:     rawinput @ >r
 1017:     s" #line " r@ over compare 0<> if
 1018: 	rdrop 1 line +! EXIT
 1019:     endif
 1020:     0. r> 6 chars + 20 >number drop >r drop line ! r> ( c-addr )
 1021:     dup c@ bl = if
 1022: 	char+ dup c@ [char] " <> 0= s" sync line syntax" ?print-error
 1023: 	char+ dup 100 [char] " scan drop swap 2dup - save-mem filename 2!
 1024: 	char+
 1025:     endif
 1026:     dup c@ nl-char <> 0= s" sync line syntax" ?print-error
 1027:     skipsynclines @ if
 1028: 	dup char+ rawinput !
 1029: 	rawinput @ c@ cookedinput @ c!
 1030:     endif
 1031:     drop ;
 1032: 
 1033: : ?nextchar ( f -- )
 1034:     s" syntax error, wrong char" ?print-error
 1035:     rawinput @ endrawinput @ <> if
 1036: 	rawinput @ c@
 1037: 	1 chars rawinput +!
 1038: 	1 chars cookedinput +!
 1039: 	nl-char = if
 1040: 	    checksyncline
 1041: 	    rawinput @ line-start !
 1042: 	endif
 1043: 	rawinput @ c@ cookedinput @ c!
 1044:     endif ;
 1045: 
 1046: : charclass ( set "name" -- )
 1047:  ['] ?nextchar terminal ;
 1048: 
 1049: : .. ( c1 c2 -- set )
 1050:  ( creates a set that includes the characters c, c1<=c<=c2 )
 1051:  empty copy-set
 1052:  swap 1+ rot do
 1053:   i over add-member
 1054:  loop ;
 1055: 
 1056: : ` ( -- terminal ) ( use: ` c )
 1057:  ( creates anonymous terminal for the character c )
 1058:  char singleton ['] ?nextchar make-terminal ;
 1059: 
 1060: char a char z ..  char A char Z ..  union char _ singleton union  charclass letter
 1061: char 0 char 9 ..					charclass digit
 1062: bl singleton tab-char over add-member			charclass white
 1063: nl-char singleton eof-char over add-member complement	charclass nonl
 1064: nl-char singleton eof-char over add-member
 1065:     char : over add-member complement                   charclass nocolonnl
 1066: bl 1+ maxchar .. char \ singleton complement intersection
 1067:                                                         charclass nowhitebq
 1068: bl 1+ maxchar ..                                        charclass nowhite
 1069: char " singleton eof-char over add-member complement	charclass noquote
 1070: nl-char singleton					charclass nl
 1071: eof-char singleton					charclass eof
 1072: nl-char singleton eof-char over add-member		charclass nleof
 1073: 
 1074: (( letter (( letter || digit )) **
 1075: )) <- c-ident ( -- )
 1076: 
 1077: (( ` # ?? (( letter || digit || ` : )) **
 1078: )) <- stack-ident ( -- )
 1079: 
 1080: (( nowhitebq nowhite ** ))
 1081: <- forth-ident ( -- )
 1082: 
 1083: Variable forth-flag
 1084: Variable c-flag
 1085: 
 1086: (( (( ` e || ` E )) {{ start }} nonl ** 
 1087:    {{ end evaluate }}
 1088: )) <- eval-comment ( ... -- ... )
 1089: 
 1090: (( (( ` f || ` F )) {{ start }} nonl ** 
 1091:    {{ end forth-flag @ IF type cr ELSE 2drop THEN }}
 1092: )) <- forth-comment ( -- )
 1093: 
 1094: (( (( ` c || ` C )) {{ start }} nonl ** 
 1095:    {{ end c-flag @ IF type cr ELSE 2drop THEN }}
 1096: )) <- c-comment ( -- )
 1097: 
 1098: (( ` - nonl ** {{ 
 1099: 	forth-flag @ IF ." [ELSE]" cr THEN
 1100: 	c-flag @ IF ." #else" cr THEN }}
 1101: )) <- else-comment
 1102: 
 1103: (( ` + {{ start }} nonl ** {{ end
 1104: 	dup
 1105: 	IF	c-flag @
 1106: 		IF    ." #ifdef HAS_" bounds ?DO  I c@ toupper emit  LOOP cr
 1107: 		THEN
 1108: 		forth-flag @
 1109: 		IF  ." has? " type ."  [IF]"  cr THEN
 1110: 	ELSE	2drop
 1111: 	    c-flag @      IF  ." #endif"  cr THEN
 1112: 	    forth-flag @  IF  ." [THEN]"  cr THEN
 1113: 	THEN }}
 1114: )) <- if-comment
 1115: 
 1116: (( (( eval-comment || forth-comment || c-comment || else-comment || if-comment )) ?? nonl ** )) <- comment-body
 1117: 
 1118: (( ` \ comment-body nleof )) <- comment ( -- )
 1119: 
 1120: (( {{ start }} stack-ident {{ end 2 pick init-item item% %size + }} white ** )) **
 1121: <- stack-items
 1122: 
 1123: (( {{ prim prim-effect-in }}  stack-items {{ prim prim-effect-in-end ! }}
 1124:    ` - ` - white **
 1125:    {{ prim prim-effect-out }} stack-items {{ prim prim-effect-out-end ! }}
 1126: )) <- stack-effect ( -- )
 1127: 
 1128: (( {{ prim create-prim }}
 1129:    ` ( white ** {{ start }} stack-effect {{ end prim prim-stack-string 2! }} ` ) white **
 1130:    (( {{ start }} forth-ident {{ end prim prim-wordset 2! }} white **
 1131:       (( {{ start }}  c-ident {{ end prim prim-c-name 2! }} )) ??
 1132:    )) ??  nleof
 1133:    (( ` " ` "  {{ start }} (( noquote ++ ` " )) ++ {{ end 1- prim prim-doc 2! }} ` " white ** nleof )) ??
 1134:    {{ skipsynclines off line @ c-line ! filename 2@ c-filename 2! start }} (( nocolonnl nonl **  nleof white ** )) ** {{ end prim prim-c-code 2! skipsynclines on }}
 1135:    (( ` :  white ** nleof
 1136:       {{ start }} (( nonl ++  nleof white ** )) ++ {{ end prim prim-forth-code 2! }}
 1137:    )) ?? {{ process-simple }}
 1138:    nleof
 1139: )) <- simple-primitive ( -- )
 1140: 
 1141: (( {{ init-combined }}
 1142:    ` = (( white ++ {{ start }} forth-ident {{ end add-prim }} )) ++
 1143:    nleof {{ process-combined }}
 1144: )) <- combined-primitive
 1145: 
 1146: (( {{ make-prim to prim 0 to combined
 1147:       line @ name-line ! filename 2@ name-filename 2!
 1148:       function-number @ prim prim-num !
 1149:       start }} forth-ident {{ end 2dup prim prim-name 2! prim prim-c-name 2! }}  white ++
 1150:    (( simple-primitive || combined-primitive )) {{ 1 function-number +! }}
 1151: )) <- primitive ( -- )
 1152: 
 1153: (( (( comment || primitive || nl white ** )) ** eof ))
 1154: parser primitives2something
 1155: warnings @ [IF]
 1156: .( parser generated ok ) cr
 1157: [THEN]
 1158: 
 1159: : primfilter ( addr u -- )
 1160:     \ process the string at addr u
 1161:     over dup rawinput ! dup line-start ! cookedinput !
 1162:     + endrawinput !
 1163:     checksyncline
 1164:     primitives2something ;    
 1165: 
 1166: : process-file ( addr u xt-simple x-combined -- )
 1167:     output-combined ! output !
 1168:     save-mem 2dup filename 2!
 1169:     slurp-file
 1170:     warnings @ if
 1171: 	." ------------ CUT HERE -------------" cr  endif
 1172:     primfilter ;
 1173: 
 1174: \  : process      ( xt -- )
 1175: \      bl word count rot
 1176: \      process-file ;

FreeBSD-CVSweb <freebsd-cvsweb@FreeBSD.org>