Getting Started with LuaJ

James Roseborough, Ian Farmer, Version 2.0.3

Copyright © 2009-2012 Luaj.org. Freely available under the terms of the Luaj license.


introduction · examples · concepts · libraries · luaj api · parser · building · downloads · release notes

1 - Introduction

Goals of Luaj

Luaj is a lua interpreter based on the 5.1.x version of lua with the following goals in mind:

Differences with 1.0

In addition to the basic goals of luaj, version 2.0 is aimed at improving on the 1.0 vm in the following aspects.

Performance

Good performance is a major goal of luaj. The following table provides measured execution times on a subset of benchmarks from the computer language benchmarks game in comparison with the standard C distribution.
Project Version Mode    Benchmark execution time (sec)    Language Sample command
binarytrees 15 fannkuch 10 nbody 1e6 nsieve 9
luaj 2.0 -b (luajc) 2.980 5.073 16.794 11.274 Java java -cp luaj-jse-2.0.3.jar;bcel-5.2.jar lua -b fannkuch.lua 10
-j (lua2java) 4.463 5.884 16.701 13.789 java -cp luaj-jse-2.0.3.jar lua -j fannkuch.lua 10
-n (interpreted) 12.838 23.290 36.894 15.163 java -cp luaj-jse-2.0.3.jar lua -n fannkuch.lua 10
lua 5.1.4 17.637 16.044 15.201 5.477 C lua fannkuch.lua 10
jill 1.0.1 44.512 54.630 72.172 20.779 Java
kahlua 1.0 jse 22.963 63.277 68.223 21.529 Java
mochalua 1.0 50.457 70.368 82.868 41.262 Java
Luaj in interpreted mode performs well for the benchmarks, and even better when source-to-source (lua2java) or bytecode-to-bytecode (luajc) compilers are used, and actually executes faster than C-based lua in some cases. It is also faster than Java-lua implementations Jill, Kahlua, and Mochalua for all benchmarks tested.

2 - Simple Examples

Run a lua script in Java SE

From the main distribution directory line type:

	java -cp lib/luaj-jse-2.0.3.jar lua examples/lua/hello.lua

You should see the following output:

	hello, world
To see how luaj can be used to acccess most Java API's including swing, try:
	java -cp lib/luaj-jse-2.0.3.jar lua examples/lua/swingapp.lua

Compile lua source to lua bytecode

From the main distribution directory line type:

	java -cp lib/luaj-jse-2.0.3.jar luac examples/lua/hello.lua
	java -cp lib/luaj-jse-2.0.3.jar lua luac.out

The compiled output "luac.out" is lua bytecode and should run and produce the same result.

Compile lua source to java source

Luaj can compile to lua source code to Java source code:

	java -cp lib/luaj-jse-2.0.3.jar lua2java -s examples/lua -d . hello.lua
	javac -cp lib/luaj-jse-2.0.3.jar hello.java
	java -cp "lib/luaj-jse-2.0.3.jar;." lua -l hello

The output hello.java is Java source, that implements the logic in hello.lua directly. Once hello.java is compiled into hello.class it can be required and used in place of the original lua script, but with better performance. There are no additional dependencies for compiling or running source-to-source compiled lua.

Lua scripts can also be run directly in this mode without precompiling using the lua command with the -j option when run in JDK 1.5 or higher:

	java -cp lib/luaj-jse-2.0.3.jar lua -j examples/lua/hello.lua

Compile lua bytecode to java bytecode

Luaj can compile lua sources or binaries directly to java bytecode if the bcel library is on the class path. From the main distribution directory line type:

	ant bcel-lib
	java -cp "lib/luaj-jse-2.0.3.jar;lib/bcel-5.2.jar" luajc -s examples/lua -d . hello.lua
	java -cp "lib/luaj-jse-2.0.3.jar;." lua -l hello

The output hello.class is Java bytecode, should run and produce the same result. There is no runtime dependency on the bcel library, but the compiled classes must be in the class path at runtime, unless runtime jit-compiling via luajc and bcel are desired (see later sections).

Lua scripts can also be run directly in this mode without precompiling using the lua command with the -b option and providing the bcel library in the class path:

	java -cp "lib/luaj-jse-2.0.3.jar;lib/bcel-5.2.jar" lua -b examples/lua/hello.lua

Run a script in a Java Application

The following pattern is used within Java SE

	import org.luaj.vm2.*;
	import org.luaj.vm2.lib.jse.*;

	String script = "examples/lua/hello.lua";
	LuaValue _G = JsePlatform.standardGlobals();
	_G.get("dofile").call( LuaValue.valueOf(script) );

A simple example may be found in

	examples/jse/SampleJseMain.java

You must include the library lib/luaj-jse-2.0.3.jar in your class path.

Run a script in a MIDlet

The for MIDlets the JmePlatform is used instead:

	import org.luaj.vm2.*;
	import org.luaj.vm2.lib.jme.*;

	String script = "examples/lua/hello.lua";
	LuaValue _G = JmePlatform.standardGlobals();
	_G.get("dofile").call( LuaValue.valueOf(script) );

The file must be a resource within within the midlet jar for dofile() to find it. Any files included via require() must also be part of the midlet resources.

A simple example may be found in

	examples/jme/SampleMIDlet.java

You must include the library lib/luaj-jme-2.0.3.jar in your midlet jar.

An ant script to build and run the midlet is in

	build-midlet.xml

You must install the wireless toolkit and define WTK_HOME for this script to work.

Run a script using JSR-223 Dynamic Scripting

The standard use of JSR-223 scripting engines may be used:

	ScriptEngineManager mgr = new ScriptEngineManager();
	ScriptEngine e = mgr.getEngineByExtension(".lua");
	e.put("x", 25);
	e.eval("y = math.sqrt(x)");
	System.out.println( "y="+e.get("y") );

All standard aspects of script engines including compiled statements should be supported.

You must include the library lib/luaj-jse-2.0.3.jar in your class path.

A working example may be found in

	examples/jse/ScriptEngineSample.java
To compile and run it using Java 1.6 or higher:
	javac examples/jse/ScriptEngineSample.java
	java -cp "lib/luaj-jse-2.0.3.jar;examples/jse" ScriptEngineSample

Excluding the lua bytecode compiler

By default, the compiler is included whenever standardGlobals() or debugGlobals() are called. Without a compiler, files can still be executed, but they must be compiled elsewhere beforehand. The "luac" utility is provided in the jse jar for this purpose, or a standard lua compiler can be used.

To exclude the lua-to-lua-bytecode compiler, do not call standardGlobals() or debugGlobals() but instead initialize globals with including only those libraries that are needed and omitting the line:

	org.luaj.vm2.compiler.LuaC.install();

Including the Lua2Java lua-source-to-Java-source compiler

To compile from lua sources to Java sources for all lua loaded at runtime, install the Lua2Java compiler after globals have been created using:

	org.luaj.vm2.jse.lua2java.Lua2Java.install();
This uses the system Java compiler to compile from Java source to Java bytecode, and cannot compile lua binary files containing lua bytecode at runtime.

Including the LuaJC lua-bytecode-to-Java-bytecode compiler

To compile from lua to Java bytecode for all lua loaded at runtime, install the LuaJC compiler after globals have been created using:

	org.luaj.vm2.jse.luajc.LuaJC.install();

This will compile all lua bytecode into Java bytecode, regardless of if they are loaded as lua source or lua binary files.

The requires bcel to be on the class path, and the ClassLoader of JSE or CDC.

3 - Concepts

Globals

The old notion of platform has been replaced with creation of globals. Two classes are provided to encapsulate common combinations of libraries.

JsePlatform

This class can be used as a factory for globals in a typical Java SE application. All standard libraries are included, as well as the luajava library. The default search path is the current directory, and the math operations include all those supported by Java SE.

JmePlatform

This class can be used to set up the basic environment for a Java ME application. The default search path is limited to the jar resources, and the math operations are limited to those supported by Java ME. All libraries are included except luajava, and the os, io, and math libraries are limited to those functions that can be supported on that platform.

4 - Libraries

Standard Libraries

Libraries are coded to closely match the behavior specified in See standard lua documentation for details on the library API's

The following libraries are loaded by both JsePlatform.standardGlobals() and JmePlatform.standardGlobals():

	base
	coroutine
	io
	math
	os
	package
	string
	table

The JsePlatform.standardGlobals() globals also include:

	luajava 

The JsePlatform.debugGlobals() and JsePlatform.debugGlobals() functions produce globals that include:

	debug

I/O Library

The implementation of the io library differs by platform owing to platform limitations.

The JmePlatform.standardGlobals() instantiated the io library io in

	src/jme/org/luaj/vm2/lib/jme/JmeIoLib.java
The JsePlatform.standardGlobals() includes support for random access and is in
	src/jse/org/luaj/vm2/lib/jse/JseIoLib.java

OS Library

The implementation of the os library also differs per platform.

The basic os library implementation us used by JmePlatform and is in:

	src/core/org/luaj/lib/OsLib.java
A richer version for use by JsePlatform is :
	src/jse/org/luaj/vm2/lib/jse/JseOsLib.java
Time is a represented as number of milliseconds since the epoch, and most time and date formatting, locales, and other features are not implemented.

Coroutine Library

The coroutine library is implemented using one JavaThread per coroutine. This allows coroutine.yield() can be called from anywhere, as with the yield-from-anywhere patch in C-based lua.

Luaj uses WeakReferences and the OrphanedThread error to ensure that coroutines that are no longer referenced are properly garbage collected. For thread safety, OrphanedThread should not be caught by Java code. See LuaThread and OrphanedThread javadoc for details.

Debug Library

The debug library is not included by default by JmePlatform.standardGlobals() or JsePlatform.standardGlobsls() . The functions JmePlatform.debugGlobals() and JsePlatform.debugGlobsls() create globals that contain the debug library in addition to the other standard libraries. To install dynamically from lua use java-class-based require::
	require 'org.luaj.vm2.lib.DebugLib'
The lua command line utility includes the debug library by default.

The Luajava Library

The JsePlatform.standardGlobals() includes the luajava library, which simplifies binding to Java classes and methods. It is patterned after the original luajava project.

The following lua script will open a swing frame on Java SE:

	jframe = luajava.bindClass( "javax.swing.JFrame" )
	frame = luajava.newInstance( "javax.swing.JFrame", "Texts" );
	frame:setDefaultCloseOperation(jframe.EXIT_ON_CLOSE)
	frame:setSize(300,400)
	frame:setVisible(true)

See a longer sample in examples/lua/swingapp.lua for details, including a simple animation loop, rendering graphics, mouse and key handling, and image loading. Or try running it using:

	java -cp lib/luaj-jse-2.0.3.jar lua examples/lua/swingapp.lua

The Java ME platform does not include this library, and it cannot be made to work because of the lack of a reflection API in Java ME.

The lua connand line tool includes luajava.

5 - LuaJ API

API Javadoc

The javadoc for the main classes in the LuaJ API are on line at
	 http://luaj.sourceforge.net/api/2.0
You can also build a local version from sources using
	 ant doc

LuaValue and Varargs

All lua value manipulation is now organized around LuaValue which exposes the majority of interfaces used for lua computation.
	 org.luaj.vm2.LuaValue

Common Functions

LuaValue exposes functions for each of the operations in LuaJ. Some commonly used functions and constants include:
	call();               // invoke the function with no arguments
	call(LuaValue arg1);  // call the function with 1 argument
	invoke(Varargs arg);  // call the function with variable arguments, variable return values
	get(int index);       // get a table entry using an integer key
	get(LuaValue key);    // get a table entry using an arbitrary key, may be a LuaInteger
	rawget(int index);    // raw get without metatable calls
	valueOf(int i);       // return LuaValue corresponding to an integer
	valueOf(String s);    // return LuaValue corresponding to a String
	toint();              // return value as a Java int
	tojstring();          // return value as a Java String
	isnil();              // is the value nil
	NIL;                  // the value nil
	NONE;                 // a Varargs instance with no values	 

Varargs

The interface Varargs provides an abstraction for both a variable argument list and multiple return values. For convenience, LuaValue implements Varargs so a single value can be supplied anywhere variable arguments are expected.
	 org.luaj.vm2.Varargs

Common Functions

Varargs exposes functions for accessing elements, and coercing them to specific types:
	narg();                 // return number of arguments
	arg1();                 // return the first argument
	arg(int n);             // return the nth argument
	isnil(int n);           // true if the nth argument is nil
	checktable(int n);      // return table or throw error
	optlong(int n,long d);  // return n if a long, d if no argument, or error if not a long
See the Varargs API for a complete list.

LibFunction

The simplest way to implement a function is to choose a base class based on the number of arguments to the function. LuaJ provides 5 base classes for this purpose, depending if the function has 0, 1, 2, 3 or variable arguments, and if it provide multiple return values.
	 org.luaj.vm2.lib.ZeroArgFunction
	 org.luaj.vm2.lib.OneArgFunction
	 org.luaj.vm2.lib.TwoArgFunction
	 org.luaj.vm2.lib.ThreeArgFunction
	 org.luaj.vm2.lib.VarArgFunction
Each of these functions has an abstract method that must be implemented, and argument fixup is done automatically by the classes as each Java function is invoked.

For example, to implement a "hello, world" function, we could supply:

	pubic class hello extends ZeroArgFunction {
		public LuaValue call() {
			env.get("print").call(valueOf("hello, world"));
		}
	}
The value env is the environment of the function, and is normally supplied by the instantiating object whenever default loading is used.

Calling this function from lua could be done by:

 
	require( 'hello' )()
while calling this function from Java would look like:
 
	new hello().call();
Note that in both the lua and Java case, extra arguments will be ignored, and the function will be called. Also, no virtual machine instance is necessary to call the function. To allow for arguments, or return multiple values, extend one of the other base classes.

Closures

Closures still exist in this framework, but are optional, and are only used to implement lua bytecode execution.

6 - Parser

Javacc Grammar

A Javacc grammarwas developed to simplify the creation of Java-based parsers for the lua language. The grammar is specified for javacc version 5.0 because that tool generates standalone parsers that do not require a separate runtime.

A plain undecorated grammer that can be used for validation is available in grammar/Lua51.jj while a grammar that generates a typed parse tree is in grammar/LuaParser.jj

Creating a Parse Tree from Lua Source

The default lu compiler does a single-pass compile of lua source to lua bytecode, so no explicit parse tree is produced.

To simplify the creation of abstract syntax trees from lua sources, the LuaParser class is generated as part of the JME build. To use it, provide an input stream, and invoke the root generator, which will return a Chunk if the file is valid, or throw a ParseException if there is a syntax error.

For example, to parse a file and print all variable names, use code like:

	try {
		String file = "main.lua";
		LuaParser parser = new LuaParser(new FileInputStream(file));
		Chunk chunk = parser.Chunk();
		chunk.accept( new Visitor() {
			public void visit(Exp.NameExp exp) {
				System.out.println("Name in use: "+exp.name.name);
			}
		} );
	} catch ( ParseException e ) {
		System.out.println("parse failed: " + e.getMessage() + "\n"
			+ "Token Image: '" + e.currentToken.image + "'\n"
			+ "Location: " + e.currentToken.beginLine + ":" + e.currentToken.beginColumn 
			         + "-" + e.currentToken.endLine + "," + e.currentToken.endColumn);
	}
In luaj 2.0.3 error reporting was turned on in the parser so line numbers are avaiable for most parse exceptions. This example may be found in
	examples/jse/SampleParser.java

See the org.luaj.vm2.ast package javadoc for the API relating to the syntax tree that is produced.

7 - Building and Testing

Building the jars

An ant file is included in the root directory which builds the libraries by default.

Other targets exist for creating distribution file an measuring code coverage of unit tests.

Unit tests

The main luaj JUnit tests are organized into a JUnit 3 suite:

	test/junit/org/luaj/vm2/AllTests.lua

Unit test scripts can be found in these locations

	test/lua/*.lua
	test/junit/org/luaj/vm2/compiler/lua5.1-tests.zip
	test/junit/org/luaj/vm2/compiler/regressions.zip
	test/junit/org/luaj/vm2/vm1/luajvm1-tests.zip

Code coverage

A build script for running unit tests and producing code coverage statistics is in

	build-coverage.xml
It relies on the cobertura code coverage library.

8 - Downloads

Downloads and Project Pages

Downloads for all version available on SourceForge or LuaForge. Sources are hosted on SourceForge and available via sourceforge.net
	SourceForge Luaj Project Page
	SourceForge Luaj Download Area

and LuaForge:

	LuaForge Luaj Project Page
	LuaForge Luaj Project Area

9 - Release Notes

Main Changes by Version

  2.0
  • Initial release of 2.0 version
  2.0.1
  • Improve correctness of singleton construction related to static initialization
  • Fix nan-related error in constant folding logic that was failing on some JVMs
  • JSR-223 fixes: add META-INF/services entry in jse jar, improve bindings implementation
  2.0.2
  • JSR-223 bindings change: non Java-primitives will now be passed as LuaValue
  • JSR-223 enhancement: allow both ".lua" and "lua" as extensions in getScriptEngine()
  • JSR-223 fix: use system class loader to support using luaj as JRE extension
  • Improve selection logic when binding to overloaded functions using luajava
  • Enhance javadoc, put it in distribution and on line
  • Major refactor of luajava type coercion logic, improve method selection.
  • Add lib/luaj-sources-2.0.2.jar for easier integration into an IDE such as Netbeans
  2.0.3
  • Improve coroutine state logic including let unreferenced coroutines be garbage collected
  • Fix lua command vararg values passed into main script to match what is in global arg table
  • Add arithmetic metatag processing when left hand side is a number and right hand side has metatable
  • Fix load(func) when mutiple string fragments are supplied by calls to func
  • Allow access to public members of private inner classes where possible
  • Turn on error reporting in LuaParser so line numbers ar available in ParseException
  • Improve compatibility of table.remove()
  • Disallow base library setfenv() calls on Java functions

Known Issues