Software Engineering Stack Exchange is a question and answer site for professionals, academics, and students working within the systems development life cycle. It only takes a minute to sign up.
Sign up to join this community
Anybody can ask a question
Anybody can answer
The best answers are voted up and rise to the top
I have an excel file consisting of Kpi based data. I intend to develop a web based dashboard with its data source being the mentioned excel file. The dashboard only shows certain (filtered) data which is extracted through an algorithm (from the excel file). I have completed an initial version of my application which uses the excel file and shows (visualizes) filtered data on the dashboard. The problem is I didn’t use a database up till now. Why should I import data from the excel file and store it into a database. How would it help me when the system is in production. I will have to use a database to store my application state (User’s View) when he log out of the system. But, can I use a excel file in the backend when the system is deployed being the primary data source of my data driven application.
- The web interface doesn’t alter the data. The data from excel is simply read and displayed on the web interface.
- The system is being used by multiple users.
- The data consists of 50k records. (But will keep on increasing)
- The data is being queried with time ranges and other attributes.
Currently, I am using pandas to read the excel file and query it for the data needed by the frontend.
Yes databases provide certain feature that excel doesn’t but then we will have to update our database on regular time intervals (for the sake of supplying our app with latest data) plus the kpi based data doesn’t seem to be fitting the relational schema.
If you want a website based on excel data with basic filtering or visualizations, that is office 365. You can have multiple people viewing read only versions. You can probably make due with Excel for quite a while, especially if you can simply start a new file every few months.
If you want a real custom web app, you need a database. Excel isn’t really a friendly data store for a web app. Choose a database the people developing the web app are familiar with.