Thread: New versions of ws-bulkdataselect, ws-dataselect and ws-timeseries webservices

Hi Bruce,

Thanks for taking a look at the near realtime services. Unfortunately, none of my near realtime timesereis plot requests works now! If I request a plot for very near realtime (within minutes of realtime), I get two types of errors:

Error 404: Not Found

The Timeseries webservice was unable to find any data for your request.No data found for:AU,MTN,--,BHZ,2012-05-04T08:07:30.070,2012-05-04T08:07:30.070

Usage details are available from
http://www.iris.edu/ws/timeseries


Request:

http://www.iris.edu/ws/timeseries/query?net=AU&sta=MTN&loc=--&cha=BHZ&starttime=2012-05-04T07:46:02.07&duration=1288&output=plot&width=1668&height=911


Request Submitted:
2012/05/04 08:08:09.359 GMT

Service Version:
ws-timeseries:1.3.1
li4:82


-------------

Error 500: Internal Server Error

Sorry - Unexpected Error
error invoking: null
assert failed. bytesRead == -1 on first pass
java.lang.Exception: assert failed. bytesRead == -1 on first pass
at edu.iris.miniseed.LogicalRecordIterator.hasNext(LogicalRecordIterator.java:72)
at edu.iris.miniseed.MiniseedFactory.parseAndNoDecodeMiniseedFile(MiniseedFactory.java:379)
at edu.iris.dmc.wsplotter.MsPlotRunner.doIt(MsPlotRunner.java:45)
at edu.iris.dmc.wsplotter.WSPlotterServlet.serviceRequest(WSPlotterServlet.java:169)
at edu.iris.dmc.wsplotter.WSPlotterServlet.doGet(WSPlotterServlet.java:82)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:304)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:100)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:929)
at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:681)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:405)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:964)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:515)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:302)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)


Usage details are available from
http://www.iris.edu/ws/timeseries


Request:

http://www.iris.edu/ws/timeseries/query?net=II&sta=WRAB&loc=00&cha=BHZ&starttime=2012-05-04T07:49:18.82&duration=1092&output=plot&width=1668&height=911


Request Submitted:
2012/05/04 08:08:02.951 GMT

Service Version:
ws-timeseries:1.3.1
li3:82


If I request a plot for data at around realtime - ~30min or earlier, I get the above errors or a blank plot.

These requests are made using the BRB and HF channel links at: http://alomax.free.fr/projects/early-est/warning_list.html

Sorry...

Thanks,

Ciao,

Anthony


On 2012/05/03 19:05, Bruce Weertman wrote:

Hello webservice users,

The DMC has updated it's ws-bulkdataselect, ws-dataselect and ws-timeseries webservices


http://www.iris.edu/ws/bulkdataselect
http://www.iris.edu/ws/dataselect
http://www.iris.edu/ws/timeseries


User's of the DMC's FetchBulkData script should update to the latest version if you wish to select
data with microsecond resolution, older versions should continue to work as usual if microseconds
are not specified.

Users of the DMC's IRIS-WS library or MATLAB irisFetch.m are not effected.

Changes include:

-----------------------------------------
Microsecond time resolution
-----------------------------------------
Time limits may now include microsecond resolution, matching the resolution of the SEED data
in the DMC archive. Previous versions only supported millisecond time resolution.

This change allows selections to be specified at the sample level in all cases. For example,
all samples on day 2004-12-26 are selected with the following start and end times:

2004-12-26T00:00:00 2004-12-26T23:59:59.999999

This also allows users to break very large requests into smaller requests which can be
reassembled on the users end without generating gaps or overlaps.

--------------------------------------------------
Better handling of near realtime data
--------------------------------------------------
This change only effects ws-dataselect and ws-timeseries

Refreshing queries which are near realtime (i.e. cover time ranges close to the present time)
will more reliably result in newer and more current data sets being returned.
Previous versions held data cached for an hour or more.

-------------------------------------
Internal logging changes
-------------------------------------
We now better track returned http status codes to better help identify system problems

regards,
IRIS DMC web services team
_______________________________________________
webservices mailing list

webservices<at>iris.washington.edu
http://www.iris.washington.edu/mailman/listinfo/webservices

--
Sent from my iClayTablet


Anthony Lomax
161 Allée du Micocoulier, 06370 Mouans-Sartoux, France
tel: +33 (0)4 93 75 25 02 e-mail: anthony<at>alomax.net web: http://www.alomax.net

Science & Special Topics: http://www.alomax.net/science
ALomax Scientific: http://www.alomax.net/alss
_______________________________________________
webservices mailing list
webservices<at>iris.washington.edu
http://www.iris.washington.edu/mailman/listinfo/webservices

Hi Bruce,

Thanks for taking a look at the near realtime services. Unfortunately, none of my near realtime timesereis plot requests works now! If I request a plot for very near realtime (within minutes of realtime), I get two types of errors:

Error 404: Not Found

The Timeseries webservice was unable to find any data for your request.No data found for:AU,MTN,--,BHZ,2012-05-04T08:07:30.070,2012-05-04T08:07:30.070

Usage details are available from
http://www.iris.edu/ws/timeseries


Request:

http://www.iris.edu/ws/timeseries/query?net=AU&sta=MTN&loc=--&cha=BHZ&starttime=2012-05-04T07:46:02.07&duration=1288&output=plot&width=1668&height=911


Request Submitted:
2012/05/04 08:08:09.359 GMT

Service Version:
ws-timeseries:1.3.1
li4:82


-------------

Error 500: Internal Server Error

Sorry - Unexpected Error
error invoking: null
assert failed. bytesRead == -1 on first pass
java.lang.Exception: assert failed. bytesRead == -1 on first pass
at edu.iris.miniseed.LogicalRecordIterator.hasNext(LogicalRecordIterator.java:72)
at edu.iris.miniseed.MiniseedFactory.parseAndNoDecodeMiniseedFile(MiniseedFactory.java:379)
at edu.iris.dmc.wsplotter.MsPlotRunner.doIt(MsPlotRunner.java:45)
at edu.iris.dmc.wsplotter.WSPlotterServlet.serviceRequest(WSPlotterServlet.java:169)
at edu.iris.dmc.wsplotter.WSPlotterServlet.doGet(WSPlotterServlet.java:82)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:722)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:304)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:100)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:929)
at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:681)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:405)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:964)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:515)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:302)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)


Usage details are available from
http://www.iris.edu/ws/timeseries


Request:

http://www.iris.edu/ws/timeseries/query?net=II&sta=WRAB&loc=00&cha=BHZ&starttime=2012-05-04T07:49:18.82&duration=1092&output=plot&width=1668&height=911


Request Submitted:
2012/05/04 08:08:02.951 GMT

Service Version:
ws-timeseries:1.3.1
li3:82


If I request a plot for data at around realtime - ~30min or earlier, I get the above errors or a blank plot.

These requests are made using the BRB and HF channel links at: http://alomax.free.fr/projects/early-est/warning_list.html

Sorry...

Thanks,

Ciao,

Anthony


On 2012/05/03 19:05, Bruce Weertman wrote:

Hello webservice users,

The DMC has updated it's ws-bulkdataselect, ws-dataselect and ws-timeseries webservices


http://www.iris.edu/ws/bulkdataselect
http://www.iris.edu/ws/dataselect
http://www.iris.edu/ws/timeseries


User's of the DMC's FetchBulkData script should update to the latest version if you wish to select
data with microsecond resolution, older versions should continue to work as usual if microseconds
are not specified.

Users of the DMC's IRIS-WS library or MATLAB irisFetch.m are not effected.

Changes include:

-----------------------------------------
Microsecond time resolution
-----------------------------------------
Time limits may now include microsecond resolution, matching the resolution of the SEED data
in the DMC archive. Previous versions only supported millisecond time resolution.

This change allows selections to be specified at the sample level in all cases. For example,
all samples on day 2004-12-26 are selected with the following start and end times:

2004-12-26T00:00:00 2004-12-26T23:59:59.999999

This also allows users to break very large requests into smaller requests which can be
reassembled on the users end without generating gaps or overlaps.

--------------------------------------------------
Better handling of near realtime data
--------------------------------------------------
This change only effects ws-dataselect and ws-timeseries

Refreshing queries which are near realtime (i.e. cover time ranges close to the present time)
will more reliably result in newer and more current data sets being returned.
Previous versions held data cached for an hour or more.

-------------------------------------
Internal logging changes
-------------------------------------
We now better track returned http status codes to better help identify system problems

regards,
IRIS DMC web services team
_______________________________________________
webservices mailing list

webservices<at>iris.washington.edu
http://www.iris.washington.edu/mailman/listinfo/webservices

--
Sent from my iClayTablet


Anthony Lomax
161 Allée du Micocoulier, 06370 Mouans-Sartoux, France
tel: +33 (0)4 93 75 25 02 e-mail: anthony<at>alomax.net web: http://www.alomax.net

Science & Special Topics: http://www.alomax.net/science
ALomax Scientific: http://www.alomax.net/alss
_______________________________________________
webservices mailing list
webservices<at>iris.washington.edu
http://www.iris.washington.edu/mailman/listinfo/webservices