I’m looking for a developer to build a prototype iPad app that plays different music depending on where the user is reading on the screen. This project combines eye-tracking with an emotionally responsive soundtrack to create a new kind of immersive reading experience.
The app will use the front-facing camera on the iPad to track the user’s gaze and trigger audio changes as they move through a story.
We are creating a new reading experience. As you read a story the soundtrack will change based on where you are in the text.
⸻
Core Features
1. Text Display (Apple Books Style) • Fullscreen reading layout • Clean, justified text layout with serif font (similar to Apple Books) • Black text on white background • Story text should be either scrollable or paginated • Display must look like a proper e-book, not a notes app or text editor
2. Gaze-Responsive Music Playback • The text will be split into paragraphs or blocks, each linked to a unique audio file • When the user’s gaze dwells on a block for about 1 second: • Trigger the corresponding audio loop • Fade out the previous audio (or transition smoothly) • Begin looping the new track • If the user looks away or glances elsewhere, the current audio should continue looping • If they return to a previously played block, audio should not restart • The result should feel like a dynamic, mood-responsive soundtrack that adapts to the user’s place in the story — not one-to-one word syncing, but a flowing emotional bed that shifts as the narrative progresses
⸻
Flexibility Required
I need to be able to update the content myself. That means: • I should be able to swap out the story text • I should be able to change or replace audio files • I should be able to define which paragraph triggers which audio using a simple config file (JSON, text file, or similar)
This can be done manually by editing files or dragging them into folders. No admin interface is needed — just clear folder structure and documentation so I can maintain it manually.
⸻
Technical Requirements • Must use the SeeSo SDK by VisualCamp: https://seeso.io • Target platform: iPad • You can build in Swift or Unity — whichever tool you’re most comfortable with • No user accounts, no cloud sync — everything runs locally on the device • Final version must be distributed via TestFlight for testing
⸻
Deliverables • iPad app installable via TestFlight • Source files + clear instructions for editing text/audio/config • One round of revisions or fixes after initial delivery
⸻
Inputs You’ll Receive • Sample story text (e.g. a chapter from The Lion, the Witch and the Wardrobe) • Audio files (loops) for each text block • Initial mapping of which paragraph triggers which audio
⸻
Timeline • MVP build: 1–2 weeks • Additional 1 week for polish/testing if needed
⸻
Budget • Please propose a fixed price based on your estimate of the time required • Open to fair day rates if needed — just be clear in your proposal • Looking for someone who can start soon and work independently
Playful Three Brand Website Build Category: CSS, Graphic Design, HTML, JavaScript, PHP, Web Design, Web Development Budget: $30 - $250 AUD
28-Nov-2025 05:03 GMT
Daily Email & Travel Organizer Category: Admin Support, Business Writing, Customer Service, Medical, Medical Billing And Coding, Medical Devices Sales, Medical Research, Medical Writing, Time Management, Virtual Assistant Budget: ₹12500 - ₹37500 INR
Purchase Data Update Assistant Category: Data Analysis, Data Cleansing, Data Entry, Data Processing, Excel, PDF, Visual Basic, Word Budget: ₹1500 - ₹12500 INR
