We have a real-time ETL pipeline for **Claude Code conversations** that:
* **Extracts** log data in real time * **Transforms** it into structured events (timestamps, session metadata, tagging) * **Loads** it into **QuestDB** for analytics and monitoring
The current pipeline works but needs an expert to bring **data engineering best practices** — ensuring **reliability, observability, correctness, and performance** for production use.
Install the **AI Agent Host** along with the provided scripts and **Claude Code** under your own subscription. After reviewing the system and checking existing issues, send us a **detailed milestone budget** based on your findings.
* **Python 3** with ETL/data engineering expertise * Experience with **real-time streaming systems** (QuestDB, Kafka, Pulsar, etc.) * Familiarity with **ILP ingestion**, **batching**, **retries**, **data contracts** * Knowledge of **logging, monitoring, and delivery guarantees** * Basic Docker knowledge for local & production environments
---
## **Budget & Timeline**
* **Milestone 1 (Debugging):** * **Milestone 2 (Enterprise Upgrade):** * Budget: **Open to proposals after reviewing the repository**
---
## **How to Apply**
Please include:
1. Real-time ETL/data pipeline projects you’ve built or hardened 2. Your approach for ensuring **data quality, ordering, and reliability** 3. Estimated **timeline & cost** per milestone after installing and reviewing the repository.
Shopify E-Commerce Store Build Category: ECommerce, HTML, Payment Gateway Integration, SEO, Shopify, Shopify Development, Web Development, Web Design Budget: ₹750 - ₹1250 INR
25-Nov-2025 16:59 GMT
Creador(a) de Contenido UGC para Videos Cortos -- 2 Category: Content Creation, Content Strategy, Influencer Marketing, Instagram, Script Writing, Social Media Marketing, TikTok, Video Editing, Video Production, YouTube Budget: $2 - $8 USD
25-Nov-2025 16:58 GMT
Web-Based Ticketing Platform Category: API Development, Database Management, Express JS, JavaScript, Node.js, NoSQL Couch & Mongo, React.js, RESTful API, Web Development Budget: $30 - $250 USD
Pokémon Character Illustrator Needed within 1 day Category: 2D Animation, 2D Drawing, Art Consulting, Art Installation, Character Illustration, Digital Art, Graphic Design, Illustration, Photoshop Budget: $30 - $250 NZD
25-Nov-2025 16:54 GMT
Custom Translation Workflow Website -- 2 Category: API Development, HTML, MySQL, Payment Processing, PHP, Software Architecture, User Experience Research, Web Development Budget: £250 - £750 GBP