Preprocess Service

Reads unprocessed raw_packets from PostgreSQL and builds aircraft, flights, tracks, and track_points.

What it does

Waits for PostgreSQL to be ready
Reads fr24.processing_state to find the last processed raw_packet_id
Fetches the next batch of unprocessed packets
For each packet: upserts aircraft, creates/reuses a flight, appends a track_point
Advances the cursor in processing_state
Touches /tmp/preprocess-ready for Docker healthcheck

Data is fake/test for this stage — real ADS-B decoding comes later.

Variable	Default	Description
`POSTGRES_HOST`	required	DB host
`POSTGRES_PORT`	`5432`	DB port
`POSTGRES_DB`	required	DB name
`POSTGRES_USER`	required	DB user
`POSTGRES_PASSWORD`	required	DB password
`POLL_INTERVAL_SECONDS`	`5.0`	How often to poll for new packets
`BATCH_SIZE`	`20`	Packets per processing batch

pip install -r requirements.txt
export POSTGRES_HOST=localhost POSTGRES_DB=fr24 POSTGRES_USER=fr24 POSTGRES_PASSWORD=change-me
python main.py

docker build -t fr24-preprocess .
docker run --env-file ../../compose/.env fr24-preprocess