Dr. Dobb's Journal - November 2008 - (Page 35)

Instantly Search Terabytes of Text Listing One 1. void recv_data(int s_client, int recv_data_fd, pid_t send_data_pid) { 2. struct gserver_msg client_message; 3. char gt_packet[BUF_SIZE]; 4. char * p; 5. int bytes_read = 0; 6. int i = 0; 7. char last = 1; 8. char *iacptr; 9. char tb[1]; 10. int temp_bytes_read = 0; 11. 12. while ((bytes_read = read(s_client, gt_packet, sizeof(gt_packet))) > 0) { 13. iacptr = memchr(gt_packet, 255, bytes_read); 14. if (!iacptr) { 15. write(recv_data_fd, gt_packet, bytes_read); 16. } else if (iacptr && iacptr > gt_packet) { 17. if (iacptr == >_packet[BUF_SIZE - 1]) { 18. write(recv_data_fd, gt_packet, bytes_read - 1); 19. temp_bytes_read = read(s_client, tb, 1); 20. if ((unsigned char)tb[0] == 255) { 21. bytes_read = read(s_client, &client_message, sizeof(client_message)); 22. if (client_message.command == gtWSLE) { 23. (void)kill(send_data_pid, SIGALRM); 24. return; 25. } 26. } else { 27. write(recv_data_fd, tb, temp_bytes_read); 28. } 29. } 30. } else if (iacptr) { 31. if (*((unsigned char *)(iacptr + 1)) == 255) { 32. if ((iacptr + 1 + sizeof(client_message)) <= >_packet[BUF_SIZE - 1]) { 33. p = (char *)&client_message; 34. iacptr+= 2; 35. for (i = 0; i < sizeof(client_message); i++) { 36. *p = *iacptr; 37. p++; 38. iacptr++; 39. } 40. } 41. if (client_message.command == gtWSLE) { 42. (void)kill(send_data_pid, SIGALRM); 43. return; 44. } 45. } 46. } 47. } 48. if (bytes_read < 1) 49. exit(1); 40. return; 41. } N dozens of indexed, unindexed, fielded data and full-text search options (including Unicode support for hundreds of international languages) N file parsers / converters for hit-highlighted display of all popular file types N Spider supports static and dynamic web data; highlights hits while displaying links, formatting and images intact N API supports .NET, C++, Java, databases, etc. New .NET Spider API h Spider Desktop wit h Spider Network wit CD/DVDs Publish for ider Web with Sp Win & .NET Engine for Linux Engine for New 64-bit The Smart Choice for Text Retrieval ® since 1991 N “Bottom line: dtSearch manages a connection to the server application. When a control message is detected from the client, we first determine whether or not it is a gtWSLE command, in which case, on line 23 or 42 we notify the send data process that the client has gone to sleep. At this point, the recv_data() function exits and data will not be read from the client until the client transitions back to an awake and operational state. terabyte of text in a single index and returns results in less than a second” – InfoWorld N “For combing through large amounts of data,” dtSearch “leads the market” – Network Computing N dtSearch “covers all data sources powerful Web-based engines”– eWEEK N dtSearch “searches at blazing speeds” – Computer Reseller News Test Center See www.dtsearch.com for hundreds more reviews, and hundreds of developer case studies The send_data() Function The send_data() function sends data over the wire to the client. Again, the server application itself never interacts directly with a socket, but rather writes data to an intermediate queue. When the client is awake, the send_data() function reads data from the Contact dtSearch for fully-functional evaluations Figure 3: Server application-level process interaction. 1-800-IT-FINDS www.dtsearch.com November 2008 l www.ddj.com l Dr. Dobb’s Journal 35 http://www.dtsearch.com http://www.dtsearch.com http://www.dtsearch.com http://www.ddj.com

Table of Contents Feed for the Digital Edition of Dr. Dobb's Journal - November 2008

Dr. Dobb's Journal - November 2008 Contents Friday Night Fish Fry Alia Vox Developer Diaries Developer's Notebook Saving Open Source Conversations iPhone Building Your Own Web Server Green Telnet What's New In Boost Threads? Testing Service Oriented Architectures Test Case Generation, UML, and Eclipse Unit Testing Web Services C3 Programming The Agile Edge Swaine's Flames Effective Concurrency

Dr. Dobb's Journal - November 2008

For optimal viewing of this digital publication, please enable JavaScript and then refresh the page. If you would like to try to load the digital publication without using Flash Player detection, please click here.