Remastered: a highly scalable production ready project with Google Cloud services. #23
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
… Dockerfile and docker-compose setup
…rom BUILD_ variables in main.sh
… and GitHub authentication
… Dockerfile updates
…efault values; delete unused package.json
…h empty placeholders
…rror handling; remove unused Prisma files and add subdomain validation utilities
…nt out unused code in proxy server
- Introduced GCP configuration in the config module with project ID, credentials, topics, subscriptions, datasets, and tables. - Updated logController to use the correct field names for deployment logs. - Refactored index.ts to initialize PubSub to BigQuery processor and handle graceful shutdown. - Created a new utility module for processing PubSub messages and inserting them into BigQuery. - Updated types to include GCP configuration and build logs structure. - Modified build-server script to align with new log structure. - Enhanced s3-reverse-proxy to utilize GCP credentials from environment variables. - Implemented streaming reverse proxy with analytics data collection and caching.
feat: implement Cloud Run job manager for deployment builds feat: create utility for date range calculations feat: add deployment status chip component for UI representation feat: implement deployment logs page with real-time updates feat: create project deployments page with deployment history and actions refactor: update types and interfaces for deployment and logs
- Added GCP bucket name configuration to the GCP settings. - Implemented a new endpoint to retrieve deployment details by ID in the deployment controller. - Updated project controller to handle GCP storage interactions for project deletion. - Enhanced deployment routes to include the new endpoint for fetching deployment by ID. - Refactored project and deployment components in the frontend to utilize new API endpoints and improve user experience. - Updated utility functions for generating live URLs for projects. - Added project deletion functionality with confirmation in project settings. - Improved error handling and loading states across various components.
…tics data defaults - Updated Project interface to require createdAt and updatedAt fields. - Enhanced analytics data collection by providing default values for country, region, browser, and OS when not available.
… deployment status URL configuration
…ns and restore start script in package.json
… cross-origin handling
…ility and functionality - Updated the DeployPage component to enhance form handling and validation. - Improved the layout and structure of the dashboard index page for better user experience. - Added error handling for API calls and loading states. - Refactored environment variable management in the deployment form. - Enhanced type safety in TypeScript definitions for projects and deployments. - Cleaned up imports and organized code for better maintainability.
…ed security and cross-origin handling
…deployment flexibility
… cross-origin handling
…improved accessibility
- Created a new 404 Not Found HTML page with a user-friendly design using Tailwind CSS. - Implemented a streaming reverse proxy server using Express, Redis, and Google Cloud Pub/Sub. - Added middleware for analytics collection and project ID retrieval based on subdomains. - Integrated LRU caching for project ID lookups and set up error handling for proxy requests. - Configured server to clear LRU cache every 30 seconds to maintain performance.
…lper utilities - Deleted stream.js which contained the main server logic. - Introduced analytics.js for handling analytics data collection and processing. - Added helpers.js for fetching project IDs by domain using an external API. - Implemented LRUCache class for efficient caching of project IDs.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
I build on it gcp services.
Optimizations
Key Features
Services
System Architecture Diagram
Project Demonstration
View demo:
simplescreenrecorder-2025-05-21_00.17.17.mp4