CSD Related Links

CSD Links

• CSD
  • IHE FTP site
• XQuery Engines
  • In browser javascript engine: xqib
  • BaseX XML Database
  • exist-db
  • Zorba
    • Zorba and large data sets
    • IBM's Zorba and PHP article
    • Zorba source code
    • Zorba and PHP introductory slides
  • LUX
• XQuery Engine Comparison
  • Evaluation Criteria: Programming Language, Source Code Last Updated, Source Documentation, XQuery verison, XQuery Update Facility support, Data storage, Index, Client libraries (PHP, Python, Java,etc.), Mailing List/User Forum last activity

Potential Issues for Public Comment

• how to map hcIdentifier used in HPD to II ?
• no date of birth in persons
• do we need Org/Facility Contact to be required?
• orgType, orgTypeDescription, orgPrimaryName are all required but perhaps should not be. similarly for facility.
• minoccurs on orglanguage is not set, but is set for facilityLanguage
• no place to add other identifiers for facility
• should creation date be required?
• facility can be in multiple facilityorgid? how to represent one facility in multiple hierarchies that are not necc. mapped to services
• is a lastmodified time/create time for CSD doc needed?

Zorba Implementation Notes

installed subversion according to https://help.ubuntu.com/community/Subversion

• subversion installed under /home/svn/CSD with autoversioning for PUT files
• webdav under http://csd.ihris.org/svn/CSD
  • user: csd pass: ASK CARL FOR IT
• to check out: svn co http://csd.ihris.org/svn/CSD CSD --username csd
  • currently checked out to svn sub-directory of dropbox folder
• checked out the repo under /home/ubuntu:
  • svn co http://csd.ihris.org/svn/CSD /home/ubuntu/CSD
• in svn repository, the www directory should be linked to under /var/www:
  • sudo ln -s /home/ubuntu/CSD/www /var/www/CSD
• webdav php client
  • pear channel-discover pear.sabredav.org
  • pear install sabredav/Sabre_Dav
  • Probably better do an apt-get isntall. don't remember the package name

Searches

Named/Canned Xquery searches are made available under queries/search via the web dav server. If there is a file queries/search/blah/blah.xq, you can access it as http://csd.ihris.org/CSD/zorba_manager.php/search/blah/blah.xq. The dynamic context of the search is the published CSD document at time of the zorba server initialization. For the time being, and GET variables are passed on to the query

• Basic Stats defined in queries/search/stats.xq Example
• Search By NID queries/search/search_by_nid.xq Example
• Get all provider records with NIDs queries/search/all_nids.xq Example

Publishing

Named/Canned Xquery use to publish CSD documents are made available under queries/publish via the web dav server. If there is a file queries/publish/blah/blah.xq, you can access it as http://csd.ihris.org/CSD/zorba_manager.php/search/blah/blah.xq. Each document under docs, with the exclusion of CSD.xml, is available to the xquery. If the resulting document passes validation via the .xsd it is published to the web dav server.

Updating

Named/Canned Xquery use to publish CSD documents are made available under queries/publish via the web dav server. If there is a file queries/publish/blah/blah.xq, you can access it as http://csd.ihris.org/CSD/zorba_manager.php/search/blah/blah.xq. Each document under docs is available to the xquery and "CSD.xml" is set to be the default context. If the resulting document passes validation via the .xsd it is published to the web dav server.

Profiling

Currently there are no indices are the zorba server's data store. It can process about 3 NID look-ups per second:

httperf --server localhost --uri /CSD/zorba_manager.php/search/search_by_nid.xq?nid=1197580084757020 --rate 100 --num-conn 2000    --num-call 1 --timeout 1
httperf --timeout=1 --client=0/1 --server=localhost --port=80 --uri=/CSD/zorba_manager.php/search/search_by_nid.xq?nid=1197580084757020 --rate=100 --send-buffer=4096 --recv-buffer=16384 --num-conns=2000 --num-calls=1
httperf: warning: open file limit > FD_SETSIZE; limiting max. # of open files to FD_SETSIZE
Maximum connect burst length: 1

Total: connections 2000 requests 65 replies 0 test-duration 21.417 s

Connection rate: 93.4 conn/s (10.7 ms/conn, <=112 concurrent connections)
Connection time [ms]: min 0.0 avg 0.0 max 0.0 median 0.0 stddev 0.0
Connection time [ms]: connect 690.4
Connection length [replies/conn]: 0.000

Request rate: 3.0 req/s (329.5 ms/req)
Request size [B]: 128.0

Reply rate [replies/s]: min 0.0 avg 0.0 max 0.0 stddev 0.0 (4 samples)
Reply time [ms]: response 0.0 transfer 0.0
Reply size [B]: header 0.0 content 0.0 footer 0.0 (total 0.0)
Reply status: 1xx=0 2xx=0 3xx=0 4xx=0 5xx=0

CPU time [s]: user 1.53 system 19.82 (user 7.1% system 92.5% total 99.7%)
Net I/O: 0.4 KB/s (0.0*10^6 bps)

Errors: total 2000 client-timo 2000 socket-timo 0 connrefused 0 connreset 0
Errors: fd-unavail 0 addrunavail 0 ftab-full 0 other 0