IEEE Technology and Society Magazine - Winter 2013 - 13

will help to make predictions about the needed number
of workers with a particular set of skills. Furthermore,
we will focus on the support of complex tasks that need
to be performed collaboratively by crowd workers. This
will also require an investigation and extensions of
existing standards such as wS-HumanTask6 to account
for processing of complex crowdsourcing tasks.

Author Information
The author is with Siemens Corporate Technology,
Austria.

Acknowledgment
The author would like to thank B. Satzger, H. Psaier,
and S. Dustdar for providing valuable feedback on
designing CaaS.

References

[1] O. Alonso, D. E. rose, and B. Stewart, "Crowdsourcing for relevance evaluation," SIGIR Forum, vol. 42, no. 2, pp. 9-15, Nov. 2008.
[2] C. Callison-Burch and M. Dredze,"Creating speech and language
data with Amazon's Mechanical Turk," in Proc. NAACL HLT 2010
6

http://bpel.xml.org/tags/ws-humantask

leTTeRS TO THe ediTOR

Workshop on Creating Speech and Language Data with Amazon's
Mechanical Turk, CSLDAMT '10 (Stroudsburg, PA), 2010, pp. 1-12.
[3] r. ramakrishnan Doan and A.Y. Halevy, "Crowdsourcing systems
on the world-wide web," Commun. ACM, vol. 54, no. 4, pp. 86-96,
Apr. 2011.
[4] J. Howe, "The rise of crowdsourcing,"Wired, vol. 14, no. 14, pp. 1-5,
2006.
[5] P. G. Ipeirotis, "Analyzing the amazon mechanical turk market place," XRDS, vol. 17, pp. 16-21, Dec. 2010.
[6] A. Kittur, E. H. Chi, and B. Suh, "Crowdsourcing user studies with
Mechanical Turk," in Proc. 26th Annual SIGCHI Conf. Human Factors
in Computing Systems, CHI '08 (New York, NY), 2008, pp. 453-456.
[7] G. Little, L. B. Chilton, M. Goldman, and r. C. Miller, "Turkit:
Human computation algorithms on Mechanical Turk," in Proc.
23nd Annual ACM Symp. User Interface Software and Technology,
UIST '10 (New York NY), 2010, pp. 57-66.
[8] r. Munro, S. Bethard, V. Kuperman, V.T. Lai, r. Melnick,
C. Potts, T. Schnoebelen, and H. Tily, "Crowdsourcing and language
studies: The new generation of linguistic data," in Proc. NAACL HLT
2010 Workshop on Creating Speech and Language Data with Amazon's
Mechanical Turk, CSLDAMT '10 (Stroudsburg, PA), 2010, pp. 122-130.
[9] B. Sigurbjörnsson and r. van Zwol, "Flickr tag recommendation
based on collective knowledge," in Proc, 17th Int. Conf. World Wide
Web, WWW '08 (New York, NY), 2008, pp. 327-336.
[10] D. Schall, H.-L. Truong, and S. Dustdar, "Unifying human and
software services in web-scale collaborations," IEEE Internet Computing, vol. 12, no. 3 pp. 62-68, 2008.
[11] D. Schall, Service-Oriented Crowdsourcing: Architecture,
Protocols and Algorithms. Springer Briefs in Computer Science, 2012.

(continued from page 8)

The growth of mandates for Open Access, especially Open Access Green (demonstrably by far the best of the
models for Open Publishing) is rapidly exposing authors to far better designed and easier systems to submit to.
The explosive growth of online journals, many using modern Open Source software with quite good HCI
standards, is beginning to turn authors away from the pain of trying to use formal publishers legacy systems (of
which IEEE's selected system is hardly the best).
I must admit personally to have resigned as an Associate Editor of the IEEE Transactions on Intelligent
Transportation Systems some years ago due to the extremely high productivity losses and difficulties engendered
by the legacy system then in use by IEEE.
Most recently I have encountered the current system's requirements for an unprotected web access. It appears
that little has changed since my last abortive encounter via the IEEE ITS journal - but more worryingly, with little
or no improvement in the HCI standards that caused such problems in years past, the IEEE as a premier computing body is now modeling anything BUT safe web access in its mandated systems to all its authors!
while this might pass many prospective authors by, both HCI and web safety and security are now becoming
the key KPI for computing systems - and IEEE promotes both.
Is it not time for this huge body to create a model system without the legacy punishment currently visited on its
authors and editors? It is rapidly becoming essential for IEEE's credibility in the HCI, security, and business computing space - and probably for IEEE to retain authors, referees, and editors - if this issue is not addressed soon.
Yours faithfully,
Marcus Wigan
Oxford Systematics
GPO Box 126
Heidelberg, Victoria, Australia 3084
mwigan@mwigan.com

IEEE TECHNOLOGY AND SOCIETY MAGAZINE

wINTEr 2013

http://bpel.xml.org/tags/ws-humantask

Table of Contents for the Digital Edition of IEEE Technology and Society Magazine - Winter 2013