Tawhiri/start - Revision history

EllieClifford: Redirected page to Tāwhirimātea

2021-04-29T18:05:03Z

← Older revision		Revision as of 18:05, 29 April 2021
Line 1:		Line 1:
	[[~~Category:Deleted~~]]		#REDIRECT [[Tāwhirimātea]]

EllieClifford: "Remove old Tawhiri pages"

2021-04-29T17:52:14Z

"Remove old Tawhiri pages"

← Older revision		Revision as of 17:52, 29 April 2021
Line 1:		Line 1:
	~~== Tāwhirimātea ==~~		[[Category:Deleted]]

	~~Tawhiri is the name given to the next version of the~~ [[~~landing_predictor\|Landing Prediction Software]], which will probably be different enough from the current version (see below) to warrant a new name.~~

	The name comes from a [http://en.wikipedia.org/wiki/M%C4%81ori_people Māori] god of weather, which rather aptly "drove Tangaroa and his progeny into the sea" ([http://en.wikipedia.org/wiki/Tawhiri WP]).

	~~=== Introduction ===~~

	~~Long story short, the predictor consists of~~

	* Some python responsible for downloading NOAA wind data.
	* Some C responsible for solving a simple DE; Forwards Euler and assumes the balloon moves at the speed of the wind (it is still very very accurate, so not much effort is required there).
	* Some PHP responsible for drawing a map.

	~~And the motivation for this project is~~

	* The servers the python relied on were getting really slow, so that could be rewritten from scratch (done).
	* The C is old, and we want to add new features like:

	~~<pre> * Monte Carlo prediction, better integration~~
	* a floating balloon mode
	* perhaps something that takes into account the altitude of the ground when it lands
	* It would be easier to integrate the various bits if they were all written in Python. This would also ease integration with other projects too, like [[http://spacenear.us\|the tracker]] (slated for a rewrite in Python) and [[http:~~//habitat.habhub.org\|habitat]] (Python; CUSF).~~
	* PHP is disgusting.
	~~</pre>~~
	~~=== Notes ===~~

	* The project page for the previous version of the predictor has [[landing_predictor\|an extensive general overview]]
	* Some notes on how the code [[tawhiri/current_predictor\|Current Predictor (github/cusf-stanadlone-predictor/pred_src)]] works.

	~~=== Ideas ===~~

	* Rewrite the C portion of the predictor [[tawhiri/rewrite_core\|in Python]]
	* New / [[tawhiri/integration\|better integration]]
	* Different [[tawhiri/altitude_models\|altitude model]] options
	* [[tawhiri/noaa_wind_data\|Replace PyDAP]]

	~~=== Summer 2013 ===~~

	~~In the Summer of 2013, PyDAP broke. The servers became too slow to use properly.~~

	Daniel (djr61) hacked up in 2 days a replacement wind downloading program in python (gevent, numpy), that gets binary (GRIB) data off the NOAA FTP servers instead, and unpacks it to a 18GB array of doubles. The C then accesses that by memmapping the entire file into its address space and casting it to an array of the right dimensions.

	This works hilariously well with predictions now completing in under 20ms. We have gigabit internet, lots of spare power and loads of RAM, so it's not as bad as it sounds. It also hugely simplified the C code.

	~~See [https://groups.google.com/d/msg/ukhas/dgngiSs9Tak/D8TpsdJ_H44J my post to the UKHAS mailling list] for a quick summary ([https://groups.google.com/d/msg/ukhas/Y5qvjvZ5kMA/VZkl9B4-BmkJ hourlies])~~

	~~This is deployed at http://predict.habhub.org/.~~

	~~==== Some Notes: ====~~

	~~It was a 2 day sprint. There are no comments. No unit tests. It works, and the interaction of the downloader with the other bits should be fairly minimal. I intend to eventually clean it up.~~

	~~==== Code: ====~~

	* The clean, new, predictor [https://github.com/cuspaceflight/tawhiri tawhiri]
	* The C, PHP + various deployment bits: [https://github.com/cuspaceflight/tawhiri-oldui-juryrig tawhiri-oldui-juryrig]. This repository is a fork of [https://github.com/cuspaceflight/cusf-standalone-predictor cusf-standalone-predictor] ~~that jury-rigs the new downloader into the old code.~~

	~~=== Tasks ===~~

	~~# Rewrite the core predictor (in Python?)~~
	~~# Add a float mode~~
	~~# Add better integration~~
	~~# Rewrite the web interface (Python? gevent? Flask? PostgreSQL? Worker daemons?)~~

	~~=== People ===~~

	* Daniel (djr61)
	* George (gd365)
	* Ilya (im354)
	* David (db590)
	* Thomas (tp378)

EllieClifford: "Add old wiki"

2021-04-19T18:58:47Z

"Add old wiki"

New page

== Tāwhirimātea ==

Tawhiri is the name given to the next version of the [[landing_predictor|Landing Prediction Software]], which will probably be different enough from the current version (see below) to warrant a new name.

The name comes from a [http://en.wikipedia.org/wiki/M%C4%81ori_people Māori] god of weather, which rather aptly "drove Tangaroa and his progeny into the sea" ([http://en.wikipedia.org/wiki/Tawhiri WP]).

=== Introduction ===

Long story short, the predictor consists of

* Some python responsible for downloading NOAA wind data.
* Some C responsible for solving a simple DE; Forwards Euler and assumes the balloon moves at the speed of the wind (it is still very very accurate, so not much effort is required there).
* Some PHP responsible for drawing a map.

And the motivation for this project is

* The servers the python relied on were getting really slow, so that could be rewritten from scratch (done).
* The C is old, and we want to add new features like:

<pre> * Monte Carlo prediction, better integration
* a floating balloon mode
* perhaps something that takes into account the altitude of the ground when it lands
* It would be easier to integrate the various bits if they were all written in Python. This would also ease integration with other projects too, like [[http://spacenear.us|the tracker]] (slated for a rewrite in Python) and [[http://habitat.habhub.org|habitat]] (Python; CUSF).
* PHP is disgusting.
</pre>
=== Notes ===

* The project page for the previous version of the predictor has [[landing_predictor|an extensive general overview]]
* Some notes on how the code [[tawhiri/current_predictor|Current Predictor (github/cusf-stanadlone-predictor/pred_src)]] works.

=== Ideas ===

* Rewrite the C portion of the predictor [[tawhiri/rewrite_core|in Python]]
* New / [[tawhiri/integration|better integration]]
* Different [[tawhiri/altitude_models|altitude model]] options
* [[tawhiri/noaa_wind_data|Replace PyDAP]]

=== Summer 2013 ===

In the Summer of 2013, PyDAP broke. The servers became too slow to use properly.

Daniel (djr61) hacked up in 2 days a replacement wind downloading program in python (gevent, numpy), that gets binary (GRIB) data off the NOAA FTP servers instead, and unpacks it to a 18GB array of doubles. The C then accesses that by memmapping the entire file into its address space and casting it to an array of the right dimensions.

This works hilariously well with predictions now completing in under 20ms. We have gigabit internet, lots of spare power and loads of RAM, so it's not as bad as it sounds. It also hugely simplified the C code.

See [https://groups.google.com/d/msg/ukhas/dgngiSs9Tak/D8TpsdJ_H44J my post to the UKHAS mailling list] for a quick summary ([https://groups.google.com/d/msg/ukhas/Y5qvjvZ5kMA/VZkl9B4-BmkJ hourlies])

This is deployed at http://predict.habhub.org/.

==== Some Notes: ====

It was a 2 day sprint. There are no comments. No unit tests. It works, and the interaction of the downloader with the other bits should be fairly minimal. I intend to eventually clean it up.

==== Code: ====

* The clean, new, predictor [https://github.com/cuspaceflight/tawhiri tawhiri]
* The C, PHP + various deployment bits: [https://github.com/cuspaceflight/tawhiri-oldui-juryrig tawhiri-oldui-juryrig]. This repository is a fork of [https://github.com/cuspaceflight/cusf-standalone-predictor cusf-standalone-predictor] that jury-rigs the new downloader into the old code.

=== Tasks ===

# Rewrite the core predictor (in Python?)
# Add a float mode
# Add better integration
# Rewrite the web interface (Python? gevent? Flask? PostgreSQL? Worker daemons?)

=== People ===

* Daniel (djr61)
* George (gd365)
* Ilya (im354)
* David (db590)
* Thomas (tp378)