🧩 Maintaining Code Quality with pre-commit
Some tips and tools to help keep research software reproducible, reliable and robust.
pre-commit
Some tips and tools to help keep research software reproducible, reliable and robust.
This post walks through the steps involved if you want to fork a public Github repository, privately. It will show how to have an open public repository and how to mirror it in a private repository on Github.
Here are my worked examples from the very useful LinkedIn Learning course: PySpark by Example by Jonathan Fernandes : https://www.linkedin.com/learning/apache-pyspark-by-example
Scala compiles down to Java byte code, which can then be run on any system running the JVM. It would be nice if one could extend this to native system binaries that can be run anywhere. Here I walk through the steps of getting SBT-Native-Packager to create a native binary as well as a docker image that can run my 'Hello World' application.
Calling compiled Scala code inside the JVM from Python using PySpark.