Help develop a proof of concept for a technology solution:
• Scraping a large amount of data multiple times during the day from 25 websites
• Comparing the scraped data for changes and showing it in a meaningful way via a browser extension by updating the website in question (think propertylog extensions on chrome)
• Linking information to browser extension (over Chrome, Firefox, android browser [Yandex and Kiwi] and IOS Browser Safari)
• Link all data changes from the scraping to a website against user memberships. I.e. – restrict / provide access and the right level of information according to the user’s membership level
• Create a basic membership website linked to data + extension. Remember it needs to be basic to prove the Proof of concept
• Provide expertise and recommendation on what languages and platforms to use for various part of the project. For example, Python or PHP as the programming language, AWS hosting, Blockchain ledger database, cyber security?, Data analysis using data science techniques (which ones?), UI/APP for mobile web developments etc
• You will also need to do a detailed feasibility study of an app possibility for the solution. i.e. Provide a report or over a meeting demonstrating the pro’s / cons / limitations / opportunities etc. Development of the app is considered to be Part 2 of this potential long term relationship
A good reference example could be these two extensions combined and how they track data, update websites in questions . I recommended that you test them:
We will both agree and set deliverable milestones against the full requirements and release payments as we go along. We do not envisage treating this as a ‘Big bang’ delivery and more of a phased approach.
*****What do we want****
Someone experienced with:
• Complex Data scraping across multiple website with complex structures • manipulating large amount of scraped data • Web development. Extensions changing websites to display additional information • Someone experienced with developing extensions across multiple platforms (Windows, Mac, Android browsers) • Can develop a basic membership website (using themes is fine given it is a proof of concept)
***Please can you provide examples of the above requirements from your experience ****
