Home

Scrapeout

What is Scrapeout?

Overview

Typescript
SCSS
UI/UX
Django
Terraform
Docker
AWS
PostgreSQL
Neo4j

Scrapeout is a powerful linkage analysis tool that identifies connections between individuals up to 10 degrees of separation across multiple data points. It ingests data from various sources to identify linkages and undisclosed business interests, which could pose operational risks to organizations.

leaves rightleaves right
Hackathon
1st Place
leaves rightleaves right
AWS
Certified

Development

From Flask to Nextjs

Technologies

I started my web development journey with a simple Python Flask app. As the complexity of the project grew, I decided to use a frontend framework and chose React with JavaScript. This was my first rewrite. To further expand the project, I moved to Nextjs with TypeScript for the frontend and Django for the backend.

Scrapeout Infrastructure

Setting up for Production

Infrastructure

Setting up the infrastructure for production was the most complicated part of the project. I chose AWS with Terraform for the backend infrastructure and Vercel for the frontend. I also integrated a CI/CD pipeline with GitLab in order to automate everything. To ensure that the infrastructure was working properly, I went through the AWS Overdrive program to get a certification.

Customizing the Frontend

Design

I also enjoyed working on the frontend, building a custom UI library with custom SCSS. To make the codebase easier to manage as the project grew, I moved the frontend into a monorepo with the documentation website and the UI library website. This allowed me to reuse the same code and styles for everything.

Learning Beyond Coding

Entrepreneurship

Working on this project also taught me a lot about entrepreneurship. I had to interact with clients, investors, and handle the administrative, legal, and accounting aspects of the project. This gave me a better understanding of the business side of things and how to manage a project. I also developed leardership and communication skills.

Conclusion

A Rewarding Experience

Reflexion

Overall, this project was a rewarding experience. I was able to learn and apply a variety of skills, from coding to infrastructure and entrepreneurship. I am proud of the progress. I am looking forward to continuing to develop my skills.