« Project bashj : a bash mutant with java support » : différence entre les versions
Aucun résumé des modifications |
Aucun résumé des modifications |
||
(149 versions intermédiaires par le même utilisateur non affichées) | |||
Ligne 1 :
== What ? ==
The '''bashj''' project is hosted on [https://sourceforge.net/projects/
The bashj code combines
*java '''performance '''and'''readability'''
*bash '''power '''and'''versatility'''
<span style="color:#008000;"><cite>-> Current version '''1.0
This page is an introduction to bashj, with general notes and installation guide.
There is also a '''[[Bashj_programming_guide|<span style="background-color:#E6E6FA;">bashj programming guide</span>]]''' page.
To bash developers, bashj brings
*'''Readability''' in the java section (OO style coding)
*JVM '''efficiency''' for CPU intensive components
*modular '''extensibility''' using java packages
*'''floating point''' (double) values variable and evaluation functions
*'''Math''' tools
*'''Swing''' UI tools
*'''Inter process''' tools between multiple bash process (and java process)
*Host '''registry'''
*...
== Why ? ==
Ligne 14 ⟶ 31 :
Java and bash are often partners in software projects.
<blockquote>
<cite>Personnally I used both of them widely. Being rather lazy, I tried to minimize the number of necessary techonologies in my projects. These two covered 99% of my needs together. Java is perfect to translate concepts into software. But bash is necessary for various OS level tasks, like process control, deployment ...
<cite>Since bashj appeared to offer significant benefits, I decided to make it publicly available.</cite>
<cite>In terms of genetics, consider bashj as a bash mutant, whose genome has been loaded with wide portions of the java genome. </cite>
</blockquote>
Their possible interactions are numerous but limited in terms of integration.
With this project, any script is given the capacity to
== How ? ==
[[File:Bashj flows.png|800x450px|Bashj flows.png]]
A bashj server (a java background process) communicates with bash scripts (considered as clients).
Dedicated functions are internally defined, and used from bash script clients to request server actions.
The communication uses mainly TCP connections.
This may be also be seen as a kind of bash ''preprocessor'' : bash itself is finally called by the bashj process.
== Requirements and limitations ==
*'''bash''' (version
*'''Linux''' (kernel version 3.*+)
*'''java''' '''JDK''' (version 9+) (JRE is not enough)
*'''64 bits''' (because Oracle dropped 32-bits support for java from version 9)
*only public static java methods (and public static fields) may be called
*only methods with primitive types (including String) as parameters and return value (neither array, nor collections). Varargs are supported by bashj.
*no embedded invocations of java methods
*These greek characters ''<span style="font-size:larger;">φ χ ψ τ</span> ''have specific usage within bashj and may not be used in bashj sources
bashj is developped and tested on Linux (Ubuntu 18.04).
It should run (without having been tested) ''at least'' on '''64-bits debian-based linux systems''' with the components listed above (linux kernel, bash & java).
== Installation ==
The target installation directory is <span style="font-family:courier new,courier,monospace;">/opt/bashj </span>. Follow carefully these steps (commands in a terminal window)
<div style="background: rgb(238, 238, 238); border: 1px solid rgb(204, 204, 204); padding: 5px 10px; margin-left: 40px;">''download from sourceforge'' <span style="font-family:courier new,courier,monospace;">'''bashjInstall-<''version''>.tar''' </span>''<span style="font-family:arial,helvetica,sans-serif;">and</span>''<span style="font-family:courier new,courier,monospace;"> '''bashj.install'''</span></div> <div style="background: rgb(238, 238, 238); border: 1px solid rgb(204, 204, 204); padding: 5px 10px; margin-left: 40px;">''<span style="font-family:arial,helvetica,sans-serif;">go to the directory containing the downloaded files, and :</span>''</div> <div style="background: rgb(238, 238, 238); border: 1px solid rgb(204, 204, 204); padding: 5px 10px; margin-left: 40px;"><span style="font-family:courier new,courier,monospace;">sudo chmod +x ./bashj.install</span></div> <div style="background: rgb(238, 238, 238); border: 1px solid rgb(204, 204, 204); padding: 5px 10px; margin-left: 40px;"><span style="font-family:courier new,courier,monospace;">sudo ./bashj.install </span>''<span style="font-family:arial,helvetica,sans-serif;"># launching the installation script</span>''</div>
For the uninstallation:
<div style="background: rgb(238, 238, 238); border: 1px solid rgb(204, 204, 204); padding: 5px 10px; margin-left: 40px;"><span style="font-family:courier new,courier,monospace;">cd</span> ; <span style="font-family:courier new,courier,monospace;">sudo /opt/bashj/bashj.install -uninstall </span></div>
== Check, try and test ==
Various bashj scripts examples are in <span style="font-family:courier new,courier,monospace;">/var/lib/bashj/example/.</span><span style="font-family:arial,helvetica,sans-serif;">Open a bash terminal window and type the following commands to discover bashj's elementary actions.</span>
<div style="background: rgb(238, 238, 238); border: 1px solid rgb(204, 204, 204); padding: 5px 10px; margin-left: 40px;"><span style="font-family:courier new,courier,monospace;">bashj -help</span></div> <div style="background: rgb(238, 238, 238); border: 1px solid rgb(204, 204, 204); padding: 5px 10px; margin-left: 40px;"><span style="font-family:courier new,courier,monospace;">bashj "Math.cos(1.0)" # check that the bashj interpreter operates</span></div> <div style="background: rgb(238, 238, 238); border: 1px solid rgb(204, 204, 204); padding: 5px 10px; margin-left: 40px;"><span style="font-family:courier new,courier,monospace;">cd /var/lib/bashj/example/ # going to the example directory</span></div> <div style="background: rgb(238, 238, 238); border: 1px solid rgb(204, 204, 204); padding: 5px 10px; margin-left: 40px;"><span style="font-family:courier new,courier,monospace;">ls # view list of examples</span></div> <div style="background: rgb(238, 238, 238); border: 1px solid rgb(204, 204, 204); padding: 5px 10px; margin-left: 40px;"><span style="font-family:courier new,courier,monospace;">cat javaLang # having a look at the code</span></div> <div style="background: rgb(238, 238, 238); border: 1px solid rgb(204, 204, 204); padding: 5px 10px; margin-left: 40px;"><span style="font-family:courier new,courier,monospace;">./javaLang # running the code</span></div> <div style="background: rgb(238, 238, 238); border: 1px solid rgb(204, 204, 204); padding: 5px 10px; margin-left: 40px;"><span style="font-family:courier new,courier,monospace;">cat check</span></div> <div style="background: rgb(238, 238, 238); border: 1px solid rgb(204, 204, 204); padding: 5px 10px; margin-left: 40px;"><span style="font-family:courier new,courier,monospace;">./check</span></div> <div style="background: rgb(238, 238, 238); border: 1px solid rgb(204, 204, 204); padding: 5px 10px; margin-left: 40px;"><span style="font-family:courier new,courier,monospace;">bashj +PP factorial # understanding how bashj works internally</span></div> <div style="background: rgb(238, 238, 238); border: 1px solid rgb(204, 204, 204); padding: 5px 10px; margin-left: 40px;"><span style="font-family:courier new,courier,monospace;">./all # run all examples - shows execution speed</span></div>
The same may be realized for all example scripts.
It is suggested to try, copy, adapt these examples scripts.
== Configuration ==
No configuration is necessary.
However it is possible for the user to put various jar files under the <span style="font-family:courier new,courier,monospace;">jarlib/ </span>directory.
All public static methods and all public static fields defined in these classes will be available in the bashj interpreter.
They should be called as indicated in the programming guide..
== Annexes ==
=== Support ===
Please contact [mailto:fil@gonze.org fil@gonze.org] for support, remarks, suggestions,...
=== bashj interactive commands ===
The bashj script may be called as interpreter, or interactively for various actions. Use <span style="font-family:courier new,courier,monospace;">bashj -help </span> to see this:
<div style="background:#eee;border:1px solid #ccc;padding:5px 10px;">
<span style="font-family:courier new,courier,monospace;">[bashj] - administrative taks - no server required<br/> bashj -help : show this<br/> bashj -status : server status<br/> bashj -stop : stops the server<br/> bashj -restart : (re-)starts the server</span>
<span style="font-family:courier new,courier,monospace;"> bashj -trace : show server trace<br/> bashj -out : check server stdOut (normally empty)<br/> bashj -err : check server stdErr (normally empty)<br/> bashj -Trace : follow server trace</span>
<span style="font-family:courier new,courier,monospace;">[bashj] - interacting with server (launched if necessary)<br/> bashj +classes <filter> : lists classes accessible to bashj clients<br/> bashj +methods <filter> : lists methods accessible to bashj clients<br/> bashj +fields <filter> : lists fields accessible to bashj clients<br/> bashj +status : server status<br/> bashj +info : server line status<br/> bashj +pp <bashj file> : preprocessor output<br/> bashj +PP <bashj file> : preprocessor analysis<br/> bashj +ex <example> : run and check example bashj script<br/> bashj +eval <expression> : call the double eval method<br/> bashj +uDoc : list utility methods from class u (bashj.u)</span>
<span style="font-family:courier new,courier,monospace;"> bashj + <call() expression(s)> : verbosely evaluate java call(argument)<br/> example: bashj + "Math.hypot(3.0,4.0)" "Math.PI" "u.classes()" <br/> bashj <call() expression(s)> : evaluate java call(argument)<br/> example: bashj "Math.hypot(3.0,4.0)" "Math.PI" "u.classes()"</span>
</div>
=== bashj interpreter mode ===
During a normal interactive bash session, it is possible to enable java calls provided by bashj. To enable the java calls , type this command:
<div style="background:#eee;border:1px solid #ccc;padding:5px 10px;"><span style="font-family:courier new,courier,monospace;">. bashj =</span></div>
And from there, the user is allowed to mix bash commands with ''j-prefixed'' commands including java calls.
<div style="background:#eee;border:1px solid #ccc;padding:5px 10px;"><span style="font-family:courier new,courier,monospace;">[bashj] bash interpreter with interactive java calls enabled<br/> enter simple bash commands, like 'ls -l' , 'ps' ...<br/> enter j-prefixed bash(j) commands, like :<br/> j echo "cos[3]=Math.cos(3)"<br/> j HYPOT="Math.hypot(3,4)"</span></div>
In interpreter mode, the'''''j'''''operates as a prefix. The command following this prefix (it is actually a bash function) is processed as if it was included in a bashj script.
=== Installed files ===
The files are installed under <span style="font-family:courier new,courier,monospace;">'''/opt/bashj/'''</span>, and include:
*'''<span style="font-family:courier new,courier,monospace;">bashjInstall</span>'''<span style="font-family:courier new,courier,monospace;"><version></span>'''<span style="font-family:courier new,courier,monospace;">.tar</span>''' (a tar file containing all bashj required files)
*'''<span style="font-family:courier new,courier,monospace;">bashj</span>''' (the central script, including the command interpreter - a link is created in '''<span style="font-family:courier new,courier,monospace;">/usr/bin</span>''')
*'''<span style="font-family:courier new,courier,monospace;">bashj.install</span>''' (installation script)
*'''<span style="font-family:courier new,courier,monospace;">bashj.wrk</span>''' (auxiliary script)
*'''<span style="font-family:courier new,courier,monospace;">bashjServer.jar</span>''' (a jar containing the compiled java class <span style="font-family:courier new,courier,monospace;">'''bashj.server.class'''</span>)
*'''<span style="font-family:courier new,courier,monospace;">README</span>''' (a readme file - short intro to this wiki page)
*<span style="font-family:courier new,courier,monospace;">'''example/'''</span> (a subdirectory with various example scripts (executable files))
*<span style="font-family:courier new,courier,monospace;">'''jarlib/'''</span> (a subdirectory with the jars choosen by the user to make the involved classes available to bashj)
*<span style="font-family:courier new,courier,monospace;">'''maps/'''</span> (a subdirectory with the persistent maps)
Working transient files are dynamically created in <span style="font-family:courier new,courier,monospace;">'''/dev/shm/bashj'''</span>, with the following subdirectories
*'''<span style="font-family:courier new,courier,monospace;">classes/</span>''' The dynamically created java classes
*<span style="font-family:courier new,courier,monospace;">'''srv/'''</span> server related data (pid, stdout, stderr)
=== Speed notes ===
The execution time of bashj is excellent due to several factors:
*TCP efficiency
*in-memory dynamic java compiling
*cache-based java class loading
*JVM global efficiciency
Simple tests (on a 2018 ''average machine'') indicate that a basic java method call requires around '''1 msec'''. This probably depends on TCP config parameters.
The startup time for a bashj script hosting java methods is around 8 msec.
For a java call involving heavy CPU load, the execution delay for the call is the same as in a direct JVM.
For the minimal "Hello world" program, the minimal and median execution times are roughly:
{| border="1" cellpadding="1" cellspacing="1" style="width: 500px;"
|-
! scope="row" |
! scope="col" style="background-color: rgb(204, 255, 255);" | minimum (msec)
! scope="col" style="background-color: rgb(204, 255, 255);" | median (msec)
|-
! scope="row" style="background-color: rgb(255, 204, 204);" | bash
| style="text-align: center;" | 2
| style="text-align: center;" | 6
|-
! scope="row" style="background-color: rgb(255, 204, 204);" | bashj
| style="text-align: center;" | 7
| style="text-align: center;" | 11
|-
! scope="row" style="background-color: rgb(255, 204, 204);" | java
| style="text-align: center;" | 72
| style="text-align: center;" | 80
|}
And this shows that in some cases, executing a simple java program from its <span style="font-family:courier new,courier,monospace;">main()</span> entrypoint is faster with bashj than with java itself !
=== Future Improvements ===
*''? Create an installable package for debian distribs''
*''? Organize the bashj server as a Linux service''
|
Dernière version du 12 juillet 2018 à 13:06
What ?
The bashj project is hosted on sourceForge. bashj is an extended bash allowing to use java libraries, methods and source code from bash scripts.
The bashj code combines
- java performance andreadability
- bash power andversatility
-> Current version 1.0 (july 2018)...
This page is an introduction to bashj, with general notes and installation guide.
There is also a bashj programming guide page.
To bash developers, bashj brings
- Readability in the java section (OO style coding)
- JVM efficiency for CPU intensive components
- modular extensibility using java packages
- floating point (double) values variable and evaluation functions
- Math tools
- Swing UI tools
- Inter process tools between multiple bash process (and java process)
- Host registry
- ...
Why ?
Java and bash are often partners in software projects.
Personnally I used both of them widely. Being rather lazy, I tried to minimize the number of necessary techonologies in my projects. These two covered 99% of my needs together. Java is perfect to translate concepts into software. But bash is necessary for various OS level tasks, like process control, deployment ... In fact I was frequently disappointed by the incapacity to reuse java results and expertise within scripts (this was only possible with heavy java process launching, and main() entry points). I was also frustrated by the strange and numerous coding conventions necessary to perform simple bash tasks. So I decided to set up and use this bashj tool.
Since bashj appeared to offer significant benefits, I decided to make it publicly available.
In terms of genetics, consider bashj as a bash mutant, whose genome has been loaded with wide portions of the java genome.
Their possible interactions are numerous but limited in terms of integration.
With this project, any script is given the capacity to quickly and directly call java methods without creating new OS processes.
How ?
A bashj server (a java background process) communicates with bash scripts (considered as clients).
Dedicated functions are internally defined, and used from bash script clients to request server actions.
The communication uses mainly TCP connections.
This may be also be seen as a kind of bash preprocessor : bash itself is finally called by the bashj process.
Requirements and limitations
- bash (version 4.*+)
- Linux (kernel version 3.*+)
- java JDK (version 9+) (JRE is not enough)
- 64 bits (because Oracle dropped 32-bits support for java from version 9)
- only public static java methods (and public static fields) may be called
- only methods with primitive types (including String) as parameters and return value (neither array, nor collections). Varargs are supported by bashj.
- no embedded invocations of java methods
- These greek characters φ χ ψ τ have specific usage within bashj and may not be used in bashj sources
bashj is developped and tested on Linux (Ubuntu 18.04).
It should run (without having been tested) at least on 64-bits debian-based linux systems with the components listed above (linux kernel, bash & java).
Installation
The target installation directory is /opt/bashj . Follow carefully these steps (commands in a terminal window)
For the uninstallation:
Check, try and test
Various bashj scripts examples are in /var/lib/bashj/example/.Open a bash terminal window and type the following commands to discover bashj's elementary actions.
The same may be realized for all example scripts.
It is suggested to try, copy, adapt these examples scripts.
Configuration
No configuration is necessary.
However it is possible for the user to put various jar files under the jarlib/ directory.
All public static methods and all public static fields defined in these classes will be available in the bashj interpreter.
They should be called as indicated in the programming guide..
Annexes
Support
Please contact fil@gonze.org for support, remarks, suggestions,...
bashj interactive commands
The bashj script may be called as interpreter, or interactively for various actions. Use bashj -help to see this:
[bashj] - administrative taks - no server required
bashj -help : show this
bashj -status : server status
bashj -stop : stops the server
bashj -restart : (re-)starts the server
bashj -trace : show server trace
bashj -out : check server stdOut (normally empty)
bashj -err : check server stdErr (normally empty)
bashj -Trace : follow server trace
. bashj = : enable interactive java calls from bash session
(type again 'bashj -help' for more help when session is enabled)
[bashj] - interacting with server (launched if necessary)
bashj +classes <filter> : lists classes accessible to bashj clients
bashj +methods <filter> : lists methods accessible to bashj clients
bashj +fields <filter> : lists fields accessible to bashj clients
bashj +status : server status
bashj +info : server line status
bashj +pp <bashj file> : preprocessor output
bashj +PP <bashj file> : preprocessor analysis
bashj +ex <example> : run and check example bashj script
bashj +eval <expression> : call the double eval method
bashj +uDoc : list utility methods from class u (bashj.u)
bashj + <call() expression(s)> : verbosely evaluate java call(argument)
example: bashj + "Math.hypot(3.0,4.0)" "Math.PI" "u.classes()"
bashj <call() expression(s)> : evaluate java call(argument)
example: bashj "Math.hypot(3.0,4.0)" "Math.PI" "u.classes()"
bashj interpreter mode
During a normal interactive bash session, it is possible to enable java calls provided by bashj. To enable the java calls , type this command:
And from there, the user is allowed to mix bash commands with j-prefixed commands including java calls.
enter simple bash commands, like 'ls -l' , 'ps' ...
enter j-prefixed bash(j) commands, like :
j echo "cos[3]=Math.cos(3)"
j HYPOT="Math.hypot(3,4)"
In interpreter mode, thejoperates as a prefix. The command following this prefix (it is actually a bash function) is processed as if it was included in a bashj script.
Installed files
The files are installed under /opt/bashj/, and include:
- bashjInstall<version>.tar (a tar file containing all bashj required files)
- bashj (the central script, including the command interpreter - a link is created in /usr/bin)
- bashj.install (installation script)
- bashj.wrk (auxiliary script)
- bashjServer.jar (a jar containing the compiled java class bashj.server.class)
- README (a readme file - short intro to this wiki page)
- example/ (a subdirectory with various example scripts (executable files))
- jarlib/ (a subdirectory with the jars choosen by the user to make the involved classes available to bashj)
- maps/ (a subdirectory with the persistent maps)
Working transient files are dynamically created in /dev/shm/bashj, with the following subdirectories
- classes/ The dynamically created java classes
- srv/ server related data (pid, stdout, stderr)
Speed notes
The execution time of bashj is excellent due to several factors:
- TCP efficiency
- in-memory dynamic java compiling
- cache-based java class loading
- JVM global efficiciency
Simple tests (on a 2018 average machine) indicate that a basic java method call requires around 1 msec. This probably depends on TCP config parameters.
The startup time for a bashj script hosting java methods is around 8 msec.
For a java call involving heavy CPU load, the execution delay for the call is the same as in a direct JVM.
For the minimal "Hello world" program, the minimal and median execution times are roughly:
minimum (msec) | median (msec) | |
---|---|---|
bash | 2 | 6 |
bashj | 7 | 11 |
java | 72 | 80 |
And this shows that in some cases, executing a simple java program from its main() entrypoint is faster with bashj than with java itself !
Future Improvements
- ? Create an installable package for debian distribs
- ? Organize the bashj server as a Linux service