Web Development :: Page Through Large Amounts Of Historical Data Via A Web Application?
Jun 29, 2009
I have a web application that functions as a dashboard, allowing a user to see summaries of historical data to view trends, etc. As an extension to this, I want to allow the user to drill-down into the historical data if they so wish.What this will amount to is a table of time-value pairs, showing the time a particular data point was recorded as well as its associated value. The issue is that there could be a very large amount of data on record (millions of points is entirely possible), which means it wouldn't work to load all the data up front and display it to the user.
So far, my best idea is to implement the table of time-value pairs with "infinite scrolling" - i.e. the first x points are loaded and then as the user scrolls down the next x points are fetched and so on until the user reaches the end of the data (with a fixed-size cache of points, so that I don't run out of memory). The issue with this approach, though, is that there's no way to get to the end of the data without first fetching every point in between.
Another option would be to have a navigation interface with forward and back buttons, as well as some sort of date chooser so the user can quickly navigate to any data point they wish. This solves the problem of the first idea, but this navigation interface is far more clunky and less intuitive.My question is: is there some happy medium? A UI where it's clean and easy to navigate through the data but at the same time provide some method of jumping to a specific point in time?
Edits based on comments below:The development environment is flex and the database is SQL Anywhere, though the back-end logistics are less important to me than a clean, functional UI.
Im not sure whats the best way is to make large amounts of data available to my android app on the local device.
For example records of food ingredients, in the 100's?
I have read and successfully created .db's using this tutorial.[url]...
However to populate the database I use flash? So this kind of defeats the purpose of it. No point in me shifting a massive array of data from flash to a sql database, when I could access the data direct from the as3 array?
So maybe I could create the .db with an external program? but then how would I include that .db in the apk file and then deploy it to users android device.
Or maybe I create a as3 class with an xml object init and use that as a means of data storage?
how "you" would do it and then deciding my strategy from there.What I'm setting out to do is as follows:I have a UI with about 10 sliders and 10 buttons.I'm using Senoculars Virtual Mouse class to record all of the users interactions into arrays (basically [x,y, action, time, value]) and then after a decided time (say 3 minutes) I play the users interaction back to them.All of that works fine but now the data is not persistent.I would like to be able to store the interaction data somewhere and then a user can log out, log in and view their previously saved interaction.how would you go about saving this data? I was thinking about storing it in a XML file but I'm concerned that the file would wind up being ridiculously huge. If a user drags a slider from left to right just once thats saving [x ,y action, time,value] 42 times.
I'm currently using XML to import geo-location data to my flash application.Even though my XML scheme is about as small as can be, I still feel i would do better downloading the variables as text and exploding them. If i manage to change the xml to raw text I can compress the data to about 35% of the original size.I want to load the data in the form a_b_c_d-e_f_g_h.So, to the question; how do I explode a datastring in flash?
I'm currently working on a project where I generate a large amount of audio data to be stored on a users machine.
It works fine for small amounts of data but as the memory usage grows the flash application begins to struggle and eventually dies.
I've been thinking about possible ways to overcome this problem and I was thinking instead of storing all the data in memory (sometimes up to 100mb) a possible solution may be to stream the data to a server (44100 float numbers per second) as it is is being generated then once the accumulation of data has ended sending it back to the client.
1) can you see any problem with this idea and if so could you offer a better alternative? 2) could you reccommend a good server technology to achieve this?
Edit 1
To add more detail.
I am generating audio on the client using the sound.extract method. As the audio is being sent to the speaker I also send it to a byte array.
Once the user has hit a stop button I prepend a wav header to the audio data in the bytearray and allow the user to download a wav of the audio they have just being listening to.
Ideally I didnt want to impose a limit of how much data the user could save. This may not be possible.Storing all this audio data in memory was causing severe performance problems in flash. I don't know of any way to incrementally store this data on the client machines so I was thinking a solution may be to incrementally stream the data to a server somewhere to reduce the memory load.
What is the best way to work large amounts of external data in Flash? XML, remoting,something else??I'm looking into a project that has a lot and I'm not sure what the best way to handle it would be
how much memory (and swf size) the various built-in data types take up in actionscript 3? I'm specifically interested in int, Number, and (dense) Arrays or Vectors. I'm working on a project where I need to embed large amounts of structured array data, which is already in C++ format, so porting is just a matter of copy-paste, search-replace. I've already had a look at Adobe's lowdown on datatypes but it's not specific enough, and doesn't mention Arrays, etc.
i'm building a site for a pharmacutical company. it's a resource guide. it's essentially a 300 page document, and turning it into a flash site, with links to external pdfs/ppt/doc files. when dealing with so much copy, what is the best way to manage/display it? in the first round of this project, i was simply putting it in flash type, with thumbnail images scattered throughout. it worked, but seemed a little bit archaic. often, with such heavy copy (3 full page scrolls), the thumbnails wouldn't align where i wanted them, and would end up overlapping with text.
I have a component I created that works like a Viewstack but the next index component slides in from one of the four sides. I've got it working well enough that it's acceptable to use, but I want to make it more efficient.
Right now I'm using a Canvas as the base component, I create a snapshot of the current view using an ImageSnapshot (new Bitmap( ImageSnapshot.captureBitmapData( this ) )), and I slide the new index on top of that image on index change.
I'm basically looking for suggestions on how to do this a better way. By taking the Image after the component loads, and after the slide happens, I've gotten the initial jaded moves down to a minimum, but we normally use this for transitioning grids so it's almost always slow on the first or first couple slides.
I've run into some problems trying to handle large text files in AIR (300+ MB in size). I can open a filestream and read the file just fine and even store it into a string variable. the problem occurs when i try to manipulate this data. Im trying to get each line as an element in an array so i can manipulate this data.Here's what i've tried:1. read the file into a string variable and perform a split looking for the newline character ). this freezes the program2. i've tried reading the file in one byte at a time and putting each line into an array AS it is being read from the filestream. This not only takes long but eventually freezes.
3. i've tried splitting the final string variable which contains the entire text file into chunks to process it separately.4. i've even tried putting the file contents into a sqlite database, but this also freezes.At this point, im not sure what my options are. Is AIR even equipped to manipulate data at this level? I could use a point in the right direction
I have made one one mobile application in flash builder using flex mobile project I have a question that "why size of an .ipa file is large as I export a mobile application as iOS application.???? in compare to that same application for android takes small size!
So I saw the tutorial on Augmented Reality and it's really awesome, but where do I get the Flex Development application like at 0:06:30? and is it free?
I am developing an application which is similar to[URL].. I need your advice on how to achive the ping and download and upload speeds. I have experience in as3, but very new to this kind of applications. can you please give your thoughts on how this application is developed.
I assume the application needs to download a file, based on the data loaded in that specific time we calculate the download speed. i am not sure about the upload and the ping.
I am currently in the process of developing an application with Flash/AS3. I have worked a lot with AS3 (FlashDevelop) before so I am rather familiar with it, however, since I won't be the one designing (nor the only one for that matter), and because it isn't a one day job, it is important to be able to get some structure in the project. So that we can have a "core" of AS3 that loads SWF-files and then does the interaction with the loaded SWFs, like providing information for fields and submitting the data, etc.
However, I've searched and I can't find any good up-to-date information on how to actually take care of the communication with the loaded SWFs. I found a lot of tutorials on it, but every single one ended up simply not working or being "depreciated" by the compiler because they were built for earlier versions of AS2/AS3 or Flash. (I found this promishing guide: [URL].. but that too ended up being depreciated) The only working piece of information I've found is LocalConnection, but it is really not well-suited for this, and from what I can tell a very complicated way to go about things.
So my question is how does one go about implementing the communication between AS3 and the loaded SWFs? Being able to dispatch events or call functions both ways is basically what I think is necessary.Or perhaps there are better ways to go about application development with Flash?
I want to develop a white board application using flex.. Can anyone tell what are the requirements and how to develop it. My plan is to develop online class room. There should be text chat, video chat, voice chat, save current class and so on.
I have an application I built in Flash that runs with no problems on Windows and OSX. I'd like to extend it to mobile platforms and I want to be able to call programs written in the native language of each platform.
I understand that Flex can be used on mobile platforms and that it can call native code, but I'm a little confused by what I've read about Flex. Can I use the Adobe Flash development environment to build Flex applications? Will our users need the Adobe Air runtime to run the programs? And what the heck does Air add to the capabilities? We need strong audio and video capabilities, a built-in database is not a requirement.
I am starting a project in which I hope to create a web application with similar elements to Google Maps, such as zooming, panning, displaying tiles, etc. The idea would be for it to have a very fluid and dynamic feel.Some possibilities that I have encountered are:
-Flash
-Silverlight
-HTML5
-Google Web Toolkit
-Javascript/jQuery
Being proficient in C# and .net, I feel that Silverlight may be the easiest for me to work with. I am worried however with regards to the penetration of Silverlight (this is a consumer-facing application). I am not asking to implement Google Maps into my web application. Rather I am attempting to create a new similar website (not mapping, but similar concepts).
From a web page, I'm looking to record audio from the user's microphone and then upload the file to a server to be stored as an MP3. My solution is built using .NET.Most similar apps that I've seen use Flash on the client and presumably Flash Media Server on the server. We don't have the kind of budget for FMS. I'm looking for a free/open source solution.I've also looked a bit at Silverlight 4 since it supports recording WAV audio but I'm not clear on how to tackle the uploading and encoding to MP3 bit.Ultimately, I need to record audio from the microphone and then be able to store the file on the server as an MP3 file. Free (or at least cheap) is required.
I am in the planning stages of developing a large web application written in Flex and was wondering if anyone has actually used FluorineFX in a large production environment?
The documentation and online community makes it seem like it could be abandoned in the years to come and I have yet to read about it being used in production.
I have been assessing Weborb as well, but the costs are extremely high and I'm not entirely satisfied with the general workflow/setup of it. Are there any other solutions out there that I should consider?
currently I am using the following code which requires me to create Linkages with the buttons. Is there a better way of doing this? also is there anyway to add a effect for example fade in and fade out.
Currently i'm developing a facebooks apps with falsh application. i've have completed the development with all API required to run a facebook apps. Everything went well and it's live now. My question :
1. How can make user to go directly to the application page everytime they click the link posted by user who already use the application instead going to the canvas page applications. i'm been trying to look for the article that support saying that user will go directly to application directly to canvas application page instead of going to the application page.
I have a scrollbar function.In the content area i attached movieclips.Those moviclips have dynamic textfield.The scroll bar working for small list of contents.up to 500 or 600 moviclipsWhen i attached 2000 or larger number of movieclip the Entire flash get slows. How to i fasten them with same number of movieclip. why flash player slow when attaching large number of movieclip? it takes near by 58% cpu usage at this time.What is the reason for
I want to create a fairly large-scale Flex web application that has a similar interface style to Grooveshark.
When it comes to web development, I have always used the common PHP/HTML/JavaScript technologies. Now, I want to try something new and develop a RIA using Flex.
Using PHP/HTML/JavaScript, I am able to develop my entire website with free tools. Now, I'm wondering if I am able to do the same thing with a Flex web application?
Is it possible/feasible to develop a Flex web application for free? If not, what would be the lowest cost I would need to spend? And, whatever the option, what are the tools that would be needed?
I'm using LoadVars to retrieve some data from a table using php. When I use the app from within my Flash environment I am able to retrieve the info, but once I post the swf to the website nothing happens. I"m posting to the same remote page. I don't think LoadVars is even firing since the trace in my else clause is not firing.
var reserved = new LoadVars(); reserved.load(" http://www.thefatblackpussycat.com/reservations/getReservedTables.php" ); reserved.onLoad = function(success)
using model driven development in developing enterprise applications. Adobe's LiveCycle Data Services looks very promising, I have found numerous tutorials/videos that shows how fast an application can be build by having methods/functions auto-generated.What are the best-practices, is it good/bad to use those auto-generated methods, they can really save a lot of time.
The game will be on a school VLE (virtual learning environment) like 'Moodle'. Can you export to email? Spreasheet? Or can it only be done with php? Do not want to be spending weeks on it!
What are your advises on using model driven development in developing enterprise applications. Adobe's LiveCycle Data Services looks very promising, I have found numerous tutorials/videos that shows how fast an application can be build by having methods/functions auto-generated.What are the best-practices, is it good/bad to use those auto-generated methods, they can really save a lot of time.
