International Collaboration in Computer Science and Engineering
11/23/98

Ronald A. Cole
University of Colorado at Boulder

José Fortes
Purdue University

Table of Contents

Executive Summary
Introduction
The Changing Landscape
Benefits of International Collaboration
Barriers to International Collaboration
Recommendations
References
Acknowledgements
Worskhop Participants

Executive Summary

This report documents our conclusion that international collaboration in science and technology is a fundamental paradigm for advancing knowledge and solving global problems. It urges the United States to take a leadership role in advancing international collaboration, and presents new models to achieve this mission.

In the United States, the Administration and Congress clearly support international collaboration in science and technology. International collaboration is viewed as a good way to leverage U.S. investment in science and technology, to position U.S. industry to capitalize on research breakthroughs, and to train U.S. researchers to collaborate with foreign colleagues to solve global problems. Further, the free exchange of ideas is viewed as a positive force for democratic change.

A clear and visionary plan of action regarding international collaboration in science and technology can be an essential component of national policy to address physical issues (e.g., global warming) and socio-political issues (e.g., economic liberalization, drug trafficking, rising standards of living around the world, increase of democratic governments). International collaboration in computer science and engineering must be an essential component of this plan.

Advances in computer science and engineering, more than any other discipline, are responsible for the internationalization of science. Advances in these areas have created a global information network that supports distributed computing and collaboration. Future advances will reduce or eliminate remaining barriers to collaboration due to time, space and language, and support a global scientific enterprise. Quite simply, the disciplines of computer science and engineering are central to international collaboration. They are creating and advancing the essential infrastructure that is used to conduct the business of science.

In October 1997, scientists in areas of computer science and engineering participated in a workshop on international collaboration sponsored by the National Science Foundation. The goals of the workshop were to: a) understand the benefits and barriers to international collaboration; b) examine current policies and programs; and, c) propose new means to increase transnational research and realize greater benefits for the U.S. and participating countries from such activities.

The participants concluded that the benefits of international collaboration justify extraordinary efforts to increase and sustain international research projects. The main benefits of these projects are: (a) the creation of new knowledge and technologies; and, (b) their application to global problems that threaten health, peace and prosperity. The main barriers to international collaboration are the lack of coherent and consistent policies and plans to promote and support such activities. The report reviews the historical context that produced current policies. This is so current policies' motivations can be contrasted easily with the barriers they pose to international collaboration.

The report concludes that the U.S. must take a leadership position in creating mechanisms for international collaboration in science and technology. This would be a significant step toward achieving many national goals. Specifically it would contribute to: a) developing a more secure, healthier, wealthier (prosperity depends on clean air and water, economically viable neighbors), and better-educated citizenry; b) advancing scientific knowledge; and c) finding solutions to global problems.

The United States has one key agency that is well positioned to lead this effort. It is the National Science Foundation. We conclude that the computer science and engineering community should be challenged to work with the NSF, and to form bridges from it to other agencies, to create programs leading to increased international cooperation on science and technology projects.

The report proposes several models to stimulate and sustain international cooperation in science and technology, namely:

International Science Foundation
The research community and NSF and should establish an International Science Foundation with participation by all nations. The new institution should have as its main goal advancing knowledge and developing technologies to solve global problems. A single organization with this mission can help remove many of the current barriers to international collaboration inherent in bilateral relationships, and develop standard procedures to initiate and sustain multinational projects.

New Computer Science Division for International Collaboration
The National Science Foundation should establish a new division within the Directorate for Computer and Information Science and Engineering (CISE) to support international collaboration. This would underscore a new national commitment to a world-orientation in building computer and intellectual infrastructure. Substantial budgetary resources should accompany the new division. Plans should ensure a focus on significant international goals where achievements are possible due to advances in computer networking. [A new CISE directorate is the appropriate administrative step because computer science plays an essential role in developing the infrastructure and tools that support the global scientific enterprise.]

International Super Centers
International Super Centers should be formed to solve specific global problems. These would be virtual collaboratives focused on physical centers of excellence. Associates would use high bandwidth networks to communicate. New technology will be in place here to enable the worlds best scientists and engineers to work together to solve global problems. [Developing them will provide computer scientists and engineers an invaluable testbed for design and test of distributed networks; distributed computing; and, collaboration technologies.]

Develop Next Generation Infrastructure and Tools
Fund explorations to advance the tools and infrastructure for international collaboration. [International projects provide the best possible environment for computer scientists to propose and evaluate advances in distributed computing, communication and collaboration.]

Expand Existing Programs in Latin America and Elsewhere
Increase the amounts for, and durations of, collaborative research projects. In developing and economically depressed countries, the U.S. should subsidize joint research projects. [We include a general conclusion that investment in international collaboration is the best form of foreign aid.] Move current NSF funding for joint research projects from modest levels [designed to stimulate initiation of collaborative research projects in new areas] to more substantial efforts. To attract the best researchers in the U.S. and other nations these programs must include follow-on funding with a joint review scheme to sift out the most successful projects.

Introduction

The radical changes in information and communication technologies sweeping the globe during the past decade are having a profound effect on the way people learn about and interact with the world, on the way business is conducted, and the way scientists and engineers do research. We are moving in rapid steps toward an age of a single, global economy and a single, global scientific enterprise.

Although professional and national competition is as vital as ever, cooperation and shared goals are gaining increasing importance. Evidence shows that international scientific collaboration leverages national investment, and can produce great benefits. International efforts to protect ecosystems and the natural environment recognize and underscore the importance of setting objectives higher than individual gain in order to provide for societal gains. This spirit of international cooperation is reflected in common market efforts, trade agreements, international recognition of intellectual property rights, and international efforts at educational reform.

The Administration has emphasized the importance of international collaboration in recent policy statements. In his address to the United Nations on October 12, 1998, Vice President Gore proposed five new challenges in a "Declaration of Interdependence". He challenged the world community to:

Today, we can only glimpse the changes that advances in information and communication technologies will bring. But as scientists who are involved in the development of these technologies, we need to look ahead and begin to create frameworks that will be successful in guiding and managing these changes, and harnessing their potential to advance science to meet global objectives as we enter the next millennium.

While the United States maintains a leadership position in many areas of information and communication technologies, federal agencies supporting computer science and engineering research have been slow to consider and implement new policies to support international collaboration. Given the global changes in communication, commerce and collaboration driven by the growth of the Internet, now is an excellent time to consider whether new policies are necessary, and if so, what issues an integrated, comprehensive policy must address.

As a start toward understanding the internationalization of science and technology, and specifically of research on computer, communication and information science and engineering, the NSF funded a Workshop on International Collaboration in Computer Science (WICCS9297). The goal of the workshop organizers and participants was to arrive at a deeper understanding of the benefits of international collaboration, the costs and risks associated with these activities, and to recommend ways to increase opportunities and optimize future benefits.

The workshop was held October 9-11 1997 in Stevenson Washington near Portland Oregon. It brought together recognized leaders and visionary young investigators. All participants were strongly interested in contributing to international scientific cooperation. The workshop agenda and the list of participants can be viewed at http:/www.cse.ogi.edu/CSLU/wiccs97/wiccs97.html . The wide-ranging discussions at the workshop mainly focussed on these issues:

This report summarizes the main insights and recommendations of the workshop. It also responds to recent developments subsequent to the workshop including new international initiatives, and recent activities of the U.S. Congress and White House. The report also includes many beneficial contributions by members of the research community who did not attend the workshop.

The main conclusion of this report is that international collaboration in computer science is vital to our national interest. This is so because international participation is required for solutions to global problems that threaten our welfare and security. Indeed some global problems could even impact the long-term survival of humanity.

Moreover, computer and information science and engineering provide infrastructure necessary to conduct the business of science. Today the essence of harnessing diverse international talent is computing and communications. Therefore the report recommends that the CISE community be challenged and given means to take leadership in promoting international collaboration in computer science and engineering. International CISE collaboration must include sufficient investigators to positively address those global problems whose solutions depend on advanced CISE technologies.

Progress toward these goals can be materially advanced by NSF activity. For example, a programmatic assertion that international CISE collaboration is of highest priority would be very significant. Similarly, the process of supporting international interaction would benefit greatly from definite standards, new research funding initiatives, and significant programs at the level of major NSF divisions. These should be focused on CISE topics, and oriented to stimulating and supporting international collaborative CISE research.

The remainder of this report is organized as follows. In the next section, we briefly review the changing landscape of U.S policy regarding international collaboration in science and technology, and the nature of the NSF=92s participation in support of international collaboration in CISE. In the following two sections, we explore the many benefits of international collaboration in CISE, as well as the barriers to international collaborations. In the final section, we submit a set of recommendations for increasing and optimizing international collaboration, while overcoming some current barriers to such activity.

 

The Changing Landscape

The Cold War Agenda

Until quite recently, science and technology policy in the United States was driven by national security needs. The critical role of science and technology in winning World War II underscored the importance of national investment in science and technology. In a 1993 report, the House Committee on Science provides this summary:

World War II dramatically altered the relationship between science, engineering, and the government. The atomic bomb, radar, nylon, penicillin, electronic computers, and a host of other products demonstrated the power of fundamental research when combined with engineering skills. Americans emerged from the war with a wholly new appreciation of the research enterprise and of the products it could generate.

This new appreciation was focused and elaborated in Vannevar Bush's 1945 report Science, the Endless Frontier. Bush, who was head of the federal Office of Scientific Research and Development during the war, argued that new knowledge generated by basic scientific research was essential to the national defense, the war against diseases, and the creation of new products, new industries, and new jobs. Traditional patronage of basic science=97primarily from philanthropies and other private sources=97was no longer sufficient; only the federal government had the resources and the broad public mandate to take full advantage of the promise offered by science [1].

During the cold war years, the U.S. research agenda in most areas of CISE was heavily influenced by DARPA, and reflected the needs of the defense establishment. Until quite recently, DARPA was the only federal agency with sufficient resources to support large multi-site programs in computer science with ambitious, long-term goals. These programs have provided both a stimulus and a model for programs in other countries. For example, in the areas of speech and natural language, DARPA sponsored programs in which research results were evaluated in international competitions run by NIST. These competitions engaged international research communities in common research and system development efforts. The net result of this implicit form of collaboration is an amplification of the national effort to achieve world-relevant scientific U.S. goals.

Transition

The end of the Cold War had dramatic effects on our nation=92s international science and technology policy. In a 1995 report submitted by the President to Congress [2], a new agenda was proposed for international collaboration in science and technology. The new agenda was based on five tenets: (a) promoting the spread of democracy worldwide; (b) promoting and maintaining peace; (c) promoting economic growth and sustainable development; (d) solving global problems; and (e) providing humanitarian assistance.

In 1997, the Speaker of the House of Representatives charged the House Committee on Science to develop a new science and technology policy for the U.S. The letter included the following motivation for this task:

With the collapse of the Soviet Union, and the de facto end of the Cold War, the Vannevar Bush approach is no longer valid. Appealing to national pride in the sense that "Our science is better than your science" is no longer meaningful to the American public. The needs of our military mission today are far different, and the competitions we are engaged in now are less military and largely economic. Science today is an international enterprise, and we must assume a leadership role in guiding international science policy. [3]

In the Congressional Hearings that followed in March of 1998, Congressman Vernon Ehlers noted the importance of international collaboration in his opening statement [4]:

"While the United States still leads the world in the largest number of research disciplines, the growth of modern communications technologies, coupled with the existence of cutting-edge scientific research programs in foreign countries, has made it both possible and scientifically useful for the United States to leverage our own investments in research with those taking place in foreign nations. Not only does this allow U.S. researchers access to unique research, it allows them to reap the full benefits of that research at a fraction of the cost of performing the research ourselves. International collaborations also help build positive, sustainable relations with other nations based upon mutual self-interest. Even more importantly to the United States, we are perfectly positioned to take advantage of the new knowledge we gain through international collaborations with foreign researchers because we have the most fertile innovation environment in the world."

Recent Events and Current Trends

In Computer Science and Engineering, the vast majority of international collaboration occurs at the level of individual investigators, or through collaborative relationships between research laboratories or academic institutions. The NSF's Division of International Programs (INT) coordinates international programs for graduate students, postdoctoral and junior investigators; joint research projects for more senior scientists and engineers; and supports planning visits and international workshops. In many cooperative research projects INT works with other NSF research divisions to support internationalization of projects supported by those divisions.

The NSF's INT division provides a vital role in stimulating and supporting international collaboration in computer science. The focus is on exploring collaborative opportunities through workshops and visits, and supporting initial collaborative partnerships for several years at the level of an individual investigator grant. INT's goal is to stimulate international collaboration, and to fund new cooperative projects for a period of two or three years. Activities supported by INT require direct cooperation between U.S. scientists and foreign scientists and their respective institutions, and cost sharing by each side. The exact requirements of joint research projects depend upon the bilateral agreements between the U.S and its partner countries.

In the past two years, the NSF=92s funding of computer science related research has increased dramatically, with major initiatives such as the $68 million Knowledge and Distributed Information initiative. For the first time, the NSF funding of computer science and engineering research exceeded funding by DARPA. Moreover, the NSF has sponsored an increasing number of programs encouraging interdisciplinary efforts, multiple institutions, and technology transfer from laboratories to classrooms. These new programs reflect changing national priorities, and the growing realization that advances in computer science and engineering are vital to our national interest. These new initiatives and programs have not included an international component.

The United States and European Union (EU) are currently working together through joint efforts to support international collaboration in digital libraries and multilingual information management. Both the U.S. and EU support substantial research efforts in these areas, and are seeking to accelerate progress by leveraging on existing work and the many benefits of international collaboration.

In the area of Digital libraries (DL), both the U.S. and EU support substantial research efforts. Although the digital libraries they are creating are inherently international, by and large, scientists involved in the U.S. and EU DL projects have not had the opportunity to work together. To meet this challenge for an international DL research agenda, the Special Programs Division of the National Science Foundation and the EU have established five working groups in key technical infrastructure areas of digital libraries. The five working groups have each met over the last two years and are finalizing a white paper with recommendations. A summary of this program can be found at http://www.si.umich.edu/UMDL/EU_Grant/home.htm.

Multilingual information management represents a second major area in which efforts are underway to promote collaboration between the U.S. and EU. A new study, funded by the National Science Foundation and supported by DG-13, focuses on the various technologies required for multilingual information management in general, encompassing machine translation, information retrieval, language resources, information extraction, text summarization, evaluation, multimedia work, speech processing, and language and speaker identification. The aim of this study is to review the historical development of each of these areas in order to illustrate the capabilities and limitations of current approaches, and to identify the research advances needed to handle multilingual processing. The results of this working group are available as a report at http://www.cs.cmu.edu/~ref/mlim. This study also provides important input to the Digital Library program; indeed, several individuals are participating in both the DL multilingual working group and the multilingual information management study.

It is clear that there is great interest in international collaboration in computer science by members of the U.S. and EU research communities in digital libraries and multilingual information management. These activities have culminated in an agreement between the United States and the European Union to support collaboration in multilingual language technologies.

New initiatives are also underway between the U.S. and Latin America. International workshops in Brazil and Mexico, sponsored in part by the NSF, have led to joint initiatives to support international collaboration in all areas of computer science. A joint NSF/CONACyT program with Mexico has helped support a dramatic increase in support of computer science research in Mexico, and has resulted in notable success stories resulting from joint research funded through this initiative. International collaboration between the U.S and Brazil is now supported through a joint NSF/CNPq initiative, which provides up to $200k of support for U.S. researchers to collaborate on joint projects of up to three years duration with their Brazilian colleagues.

The NSF has joined other nations in funding the interconnection of their networks, as exemplified by TransPAC and Startap. TransPAC provides high performance international Internet service connecting the Asia Pacific Advanced Network to the vBNS and other global networks for international collaborations in research and education. It is funded by the National Science Foundation and the Japan Science and Technology Agency. The NSF CISE Networking and Communications Research and Infrastructure (NCRI) division funded STAR TAP, the Chicago Science, Technology And Research Transit Access Point, a persistent infrastructure to facilitate the long-term interconnection and interoperability of advanced international networking in support of applications, performance measuring, and technology evaluations. STARTAP is already linked to fast research networks in Canada, Northern Europe, TransPAC (i.e. Japan, Singapore, Taiwan) and Russia. The number of interconnected countries is expected to continue to increase at a fast rate.

The Opportunity

The White House and Congress have identified international collaboration in science and technology as a national priority. The research community, through this report and other efforts, has an exciting opportunity to help identify new opportunities and models for international collaboration.

Benefits of International Collaboration

This section concludes that there is a compelling case for making international collaboration in CISE a national and international priority.

Solving Global Problems

As the dominant species on this planet, it is our responsibility to support biological well being (ourselves and other creatures), protect future generations and foster global health and prosperity. Threats to our health, prosperity and future include: terrorism; drug-trafficking and abuse; compromises of computing infrastructure integrity and security; international monetary instability; spread of AIDS and other diseases; poverty and starvation; natural resource depletion; environmental pollution; bio-diversity losses; global warming; and natural disasters. Each of the above ultimately impact everyone, and are therefore global problems.

The scientific community plays an essential role in solving global problems because its work leads to understanding their causes, and the ability to evaluate potential solutions. Such work consists of defining the problem space, collecting and analyzing data, and proposing and testing solutions. The best progress in this work requires scientists from many nations: global problems require global solutions, and global solutions require global participation.

Climate change is an example of a global problem that requiring widespread participation. The consequences of even small increases in global warming -- fewer than five degrees Centigrade -- are losses of life and property.

It is well recognized that global initiatives are necessary to deal with all facets of this problem. There are a significant number of international collaboration efforts already under way in the area of Remote Sensing and Earth Observation [5]. According to Wagner=92s report [5], there are a total of 490 international agreements involving 76 countries and six multinational organizations. However, none the 15 subjects addressed by these collaborations are in CISE disciplines, despite the fact that most of these projects use or could benefit from using CISE technologies.

The applicability of CISE research to monitoring and managing global weather follows from the need to collect, process, understand, predict and evaluate (enormous amounts of) information at large numbers of world sites where unique resources (people, laboratories, sensors, computers, actuators, etc.) are located. The following lists ten sample areas of CISE research essential to world weather and other global tasks:

  1. World-level networking. Size, heterogeneity, software demands and hardware requirements of large global networks present unique CISE research problems. (This is needed to enable seamless access to weather information across the world from both sensors and databases.)
  2. Archiving and processing massive amounts of data. Coping with real-time data collection rates. (Processing accumulations of weather data is needed to address global warming, climate trends.)
  3. Intelligent data retrieval. Means to support timely selection and distribution of data. (Obtaining weather information and directing it to the people and locations where it is needed.)
  4. Distributed processing of information. Means to enable local processing and global sharing and analysis of data. (Weather information and its analyses possess value apart from its geographic source.)
  5. High-performance computing. Means to provide the necessary computational power for detailed simulation beyond the ability of any existing supercomputer. (Needed for weather simulations across the world.)
  6. Knowledge understanding and data mining. Methods to search, detect and explain phenomena from aggregated data sources. (Weather-relevant issues are present in the massive resources present in existing databases.)
  7. Computer interfaces and language translation. Technology to allow people of varied cultures and languages to work and collaborate effectively. (This is essential to create world weather management infrastructure, and to support more effective air traffic control.)
  8. Software engineering. Standards to enable worldwide software development. (Practices to support interfacing software modules developed in different countries, particularly for issues that bridge political borders, e.g. weather, natural resources, and biology.)
  9. Network-based machine operation. Means to support remote operation of sensors, actuators and instrumentation from anywhere in the world. (Seismological and weather measurements require new network modalities.)
  10. Intelligent sensor and instrumentation technology. Means to allow data to be collected anywhere and anytime. The range of such technology goes from the extremely small (nanomachines) to the uniquely large (e.g. arrays of large antennas and satellites) and encompasses a multitude of CISE topics. (As in 9., weather and other issues require new modalities.)

The above contains central CISE topics. Research activities on these themes are under way in universities, industries and national research laboratories around the world. However, global warming presents problems of unprecedented scale involving many millions of information sources networked across the world. Each source could provide a massive and continuous stream of data. Likewise, the system could require feedback control in ways that could depend on the evolution of the data. The complexity of coordinating, managing, maintaining and programming such an infrastructure dwarfs that of any system in existence today. To collect, store process and manage these data requires infrastructure involving large constituencies and capable of surviving geopolitical phenomena. The global warming problem can be solved only through novel structures ensuring world participation of specialists in computer and information science.

Leveraging International Investment

In the United States, the European Union, Japan, Korea, the former Soviet Union, and to a lesser extent elsewhere, governments and industries have spent billions of dollars advancing information and communication technologies. Joint initiatives have been created that combine the resources of government, industry and academia, and massive infrastructure has been put in place. Researchers have been educated and trained to solve problems in computer science and engineering. International collaboration can leverage this investment, building upon the infrastructure developed, the research breakthroughs achieved and new technologies developed by individual nations and groups of nations.

Cost Sharing

The 1998 House Report identifies cost sharing as an important benefit of international collaboration in science and technology. "One rationale for entering into international science collaborations is that the costs of large scale science projects, such as colliders for high-energy physics, can be shared among participating countries." Dr. Bruce Alberts, president of the National Academy of Sciences, noted that "Some research facilities are so expensive that international collaboration is necessary in order to make them affordable. In order for the U.S. to be able to capitalize on discoveries made elsewhere and facilities located elsewhere, we must have world-class researchers who maintain constant communication and work frequently in collaboration with the best scientists in other countries."[3]

Harnessing the Diverse Talent Pool

International collaboration builds upon the education, training and experience of tens of thousands of engineers and computer scientists, the lessons they have learned, and the discoveries they have made. The diversity of the talent pool produces synergistic results: Scientists from different countries approach problems with diverse skills, attitudes and perspectives that stimulate novel approaches and creative breakthroughs. Providing scientists from different countries the opportunity to work together not only increases the talent pool, but also changes and enhances it. The potential synergy of the hybrid talent pool could greatly accelerate the advancement of knowledge, the creation of new technologies, and the solutions to global problems.

Creating New Paradigms for Collaboration and Discovery

Current NSF CISE initiatives, such as Digital Libraries, Educational Innovation and Knowledge and Distributed Information (KDI), will create new technologies, tools and paradigms for scientific collaboration and discovery. International collaboration extends the scope of these activities to overcome challenges of physical distance, time zones, languages, cultures, computing environments, etc. Moreover, the scientists in different countries who collaborate to solve global problems test the effectiveness of new tools and technologies. Thus, international collaboration is a valuable laboratory for research, development and evaluation of new paradigms for scientific discovery and collaboration.

Creating Tools and Infrastructure

In addition to their role as participants in scientific inquiry, computer scientists and engineers play a special role in science and technology: they provide the infrastructure and tools used by the scientific community to conduct research and advance knowledge. This includes the infrastructure and tools used by the international community to collaborate and solve global problems.

While international collaboration in computer science is happening today, it is not now focused on study and solution of coordinated global problems. Better tools, infrastructure and focus can greatly improve our chances of understanding and solving global problems. There is thus a compelling need to overcome individual, group and national barriers to promote and support international collaboration in computer science and engineering.

New paradigms for collaboration and discovery require new infrastructure. Understanding the infrastructure needs and implementation strategies in an area that is evolving as rapidly as computer science and engineering is itself a major research challenge. It is both inefficient and risky to address problems of distributed computing and collaboration locally, and hope that these solutions generalize to support international collaboration. Similarly, in disciplines other than computer science, it is equally inefficient to develop international cooperation mechanisms and policies without any involvement by the CISE community and hope that they are the most efficient in leveraging information processing and communication techniques.

Training Tomorrow=92s Leaders

Projects that require international collaboration provide necessary training and experience for scientists, engineers and managers who must compete in an increasingly global marketplace. The graduate students who participate in global projects will gain competitive advantage, both for themselves and the companies that will employ them. These fortunate students will master the complexities of working in distributed virtual environments with people in other cultures; gain valuable insights about the limitations and capabilities of current technology; and discover opportunities for commercialization of new technologies. If the U.S. is to maintain world leadership in information and communication industry, it must train students to work and compete in a global arena.

Promoting Democracy

International collaboration promotes democracy. In his congressional testimony, Dr. Bruce Alberts noted that "In a world full of conflicting cultural values and competing needs, scientists everywhere share a powerful common culture that respects honesty, generosity and ideas independent of their source, while rewarding merit=85 Knowledge is power, and diffusing it more widely across the globe also provides a strong force that favors democracy." [3]

Promoting Economic Strength and Financial Stability

In the past five years, the high technology sector has contributed the largest share to our national growth, about double the national average. Growth in high technology is perhaps the most prominent among the factors contributing to recent U.S. economic prosperity.

A main tenet of U.S. international science and technology policy is to promote our economic well being. "While we must remain ever vigilant and militarily strong, the need to maintain economic strength has taken on primary importance today. We now recognize more clearly than ever that economic strength facilitates not only a strong defense, but promotes other societal needs, such as social and political stability, good health, and the preservation of freedom." (1998 House Report, page 4)

The Asian financial crisis underscores the extent to which the economies of individual nations are interrelated. International collaboration in computer science, computer information, and computer engineering offers a potential positive force for global financial stability by enabling developing nations to become both consumers and producers of high technology.

Good Foreign Policy

Supporting foreign research provides an excellent way to exercise U.S. policy abroad. Supporting research and education in economically depressed and developing countries could represent one of the least controversial and most efficient means of foreign aid. Such support would reach some of the most respected and influential people in targeted nations, provide means for them to collaborate with U.S. researchers, and contribute to the careers of globally aware and U.S.-friendly leaders worldwide. Foreign aid in the form of direct support for research will help less developed countries build centers of excellence, computing infrastructure and industries, and help bring developing countries into the information age. This aid can take the form of computing equipment and software produced by U.S. companies, thereby establishing markets for the U.S., and providing motivation for U.S. industry to participate in foreign research initiatives .

U.S. support of research in foreign countries through international collaboration is good foreign policy. Many countries economically depressed and developing countries have highly capable and motivated scientists and students who lack the resources to achieve their potential. Scientists in these countries are unable to participate in large international projects because they lack infrastructure, tools and training. With the ever-decreasing costs of computers, and the ability to collaborate over long distances using computer networks, relatively small investments in foreign research can produce enormous returns. Given appropriate resources and guidance by their colleagues in the U.S., scientists in these countries can establish viable research and development efforts, enabling them to participate in future multinational projects. In addition to producing advances in science and technology, investment in foreign research increases the hybrid talent pool, builds lasting professional relationships and earns good will for the U.S.

Maintaining Scientific Leadership in Information Technology

The impending transition of most of the world=92s nations into a global information society brings with it an urgent need for engineering leadership in the definition of standards, international protocols and mechanisms for trade, commerce, intellectual and cultural exchanges. In case the U.S. does not provide this leadership, other technologically advanced countries will seize this unique historical opportunity and reap the benefits.

Historically, information technologies have been strongly influenced by scientific discovery and interaction. Scientists often blaze the technology trails that industries later leverage and expand into publicly accessible infrastructures. This paradigm of technology transfer and the fact that in order to lead in technology deployment it is essential to be involved in its development are strong arguments for the early (pre-competitive) involvement of US scientists in international CISE research efforts.

Summary

The benefits described in this section indicate an urgent and vital need to accelerate international collaboration in computer science, computer information, and computer engineering. Providing the means and motivation for scientists to collaborate effectively across national and political boundaries will create the infrastructure and synergies needed to advance knowledge, create new and improved technologies and provide solutions to coordinated global problems that cannot be solved locally. In addition, international collaboration will train U.S. researchers to participate in global projects, and position U.S. industry to both provide and participate in the development of new technologies to support international efforts.

Barriers to International Collaboration

A surprising number of factors work against international collaboration in computer science and engineering. This section reviews some of the most important.  

U.S. Policy

The main barrier to international collaboration in computer science and engineering is lack of U.S. policy that promotes and supports international cooperation. Although international collaboration is now identified as a national priority, policies and programs have not yet been put in place to translate this priority into a plan of action. For example, within the National Science Foundation=92s Computer and Information Science and Engineering (NSF CISE) directorate, procedures for funding international collaboration differ from country to country, when such opportunities exist at all.

International collaboration in science and technology is the province of the Department of State. Congressional testimony by several experts noted that State is poorly provisioned to promote international collaboration or take advantage of opportunities that arise. According to Congressional testimony, the Department of State has failed to provide the necessary vision, leadership and support for international collaboration in computer science. The 1998 House Report cites testimony that "scientific expertise and commitment is severely lacking within the Department of State." Admiral Watkins noted that "leadership there always seems to be lacking in both timely enthusiasm and technical qualifications."

NSF Realities

International Collaboration in CISE has a relatively weak constituency within the NSF. Programs within CISE are driven by a constituency of managers and researchers who support and lobby for the importance of their programs. Each program has a clear focus for advancing knowledge and creating new technologies in areas of national importance. Given this organizational structure, it is difficult to motivate support for international collaboration, since funding is perceived as a "zero sum game," with support for international collaboration necessarily eliminating support for other programs. Supporting international collaboration is robbing Peter to pay Paul, and Peter is better armed.

Support for international collaboration is also relatively weak in the U.S. computer science academic community. It was surprisingly difficult to get scientists to participate in the workshop on international collaboration in computer science. Fewer than half those invited to WICSS agreed to attend. Many who agreed to attend dropped out in the weeks before the workshop. In contrast, attendance at the 1997 NSF Interactive Systems Grantees Workshop (organized by one of the authors of this report) was about 95%.

Researchers understand where the "action" is within the NSF, and invest their time in activities that promise to deliver the greatest amount of funding. The NSF divisions in CISE science have relatively large budgets to support research, and relatively small budgets to support international collaboration. The NSF=92s approach to international collaboration provides seed money to stimulate collaborative activities, such as travel, workshops, visits, postdoctoral training. A limited number of collaborative research projects are also supported at modest funding levels. Because the NSF does not provide resources to fund major efforts involving international collaboration, these efforts are not taken seriously by the research community. Whether intentional or not, the NSF sends a message to researchers in computer science and engineering: International collaboration is encouraged but is not a priority.

This message is reinforced by the resources allocated to marketing and funding international programs in computer science within the NSF. According to Caroline Wagner [6] the funds allocated to CISE international collaborative research by the US in FY95 are less than 0.1% of the total amount, placing CISE in 13th place among 18 disciplines. Within the NSF, the CISE allocation for international collaboration ranked last among the 12 disciplines considered in Wagner=92s report, corresponding to approximately 1% of the total CISE budget and to 1% of the total NSF funds used for international collaborative research.

National Priorities versus International Collaboration

Funding of research in computer science and engineering in the United States is guided by national priorities, such as the desire to maintain technological superiority in areas of computing and communication. National priorities are often in conflict with the outcomes of international collaboration=97shared knowledge and technology=97since research advances and new technologies are no longer "owned" by the U.S. This conflict is compounded by industry participation in federally funded projects (stimulated by agencies=92 requirements of matching funds), since industry participation is often motivated in part by the opportunity for competitive advantage in the marketplace. These same barriers to international participation are present=97to greater or lesser extent=97in all countries.

In addition to the forces of capitalism and the realities of the marketplace, international collaboration, and its funding by Congress, is influenced by attitudes shaped by the Cold War. The 1998 House Report reminds us that "The political consensus necessary to build today=92s science and engineering enterprise was forged largely by the Nation=92s needs and priorities in the period following the second World War, when the threat of total destruction by nuclear weapons was frighteningly real. Under these circumstances, the exigencies of the Cold War made science politically unassailable." [3] While the 1998 House Report acknowledges that international collaboration is a "strong force that favors democracy," it is difficult to change the attitudes of the past, and the role of international collaboration in science and technology is probably viewed with great suspicion by many.

Bureaucracy

For international collaboration to be truly effective, collaboration must occur between national governments and their agencies. Even when all parties share the same vision, existing rules and regulations (immigration, taxation, etc.) complicate the process. Government bureaucracy may be frustrating to researchers and program managers within the U.S., but the effects of government bureaucracies attempting to work together on international programs are truly enlightening.

Personal Realities

The Workshop on International Collaboration in Computer Science began with a session entitled "The Good, The Bad and The Ugly," in which participants shared feelings and stories about international collaboration. A clear consensus emerged from our work that the benefits of international collaboration outweigh the difficulties and hardships often encountered. U.S. researchers' motivations range from the desire to collaborate with the best people in the world, to the desire to help talented colleagues in less prosperous countries who cannot realize their creative potential because of insufficient resources.

Summary

There are significant barriers to international collaboration in computer science. Because there is a clear, important and urgent need to increase international collaboration, the computer science research community seeks to facilitate international collaboration, and to remove current barriers to such activities. This will require proposing, examining and testing new models for international collaboration. We present a set of recommendations for consideration. These share the common theme that the goal of new programs and models is to dramatically increase opportunities for international collaboration.

Recommendations

Establish a New CISE Division: International Collaboration in Computer Science and Engineering (ICCSE)

The research community would like the NSF to consider establishing a new division in CISE: International Collaboration in Computer Science and Engineering (ICCSE). Having a CISE division devoted to promoting and supporting international research efforts removes the most serious barriers to international collaboration. The division would have significant resources; would develop a strong constituency with the CISE community; and would become an effective partner with the NSF=92s International Division.

The research community feels that the NSF is uniquely qualified to assume leadership in international collaboration in computer science and engineering. The NSF CISE directorate is one of the leading agencies worldwide supporting research in computer science and engineering. CISE has demonstrated an increasing interest in international collaboration, with recent international initiatives announced or underway with European partners (Digital Libraries, Multilingual Language Resources) and joint initiatives in Mexico (with CONACyT) and Brazil (with CNPq). To quote the recommendations of J. Thomas Ratchford, Director of the Center for Science, Trade, and Technology Policy of George Mason University [7]:

"=85 there is a special role for the NSF in effecting these solutions. The NSF is highly respected at home and abroad, the NSF organic act provides the authority and the existing NSF international office provides a solid base from which to grow the analytic capability."

Establishing a new division within CISE would demonstrate the high priority, commitment and focus that international collaboration requires. Divisions within the NSF have status and stability. Formation of a new division within the NSF CISE is a significant event; it underscores the importance that the U.S. and its CISE research community assign to international collaboration. It sends a clear message to other governments and research agencies that the U.S. assigns high priority to initiating and supporting international collaboration in computer science, and establishes the NSF as the point of contact for initiating new programs.

An appropriate mission of the new division would be would be to serve the national interest by advancing scientific knowledge in computer science and engineering through international collaboration. The division, for example, could promote and coordinate establishment of international "super centers" to solve global problems. Additional goals might be to support training of U.S. researchers through participation in international projects; to help establish global computing and communications infrastructure for international collaboration in science and technology; and to support the development of new technologies for solving global problems through international collaboration.

An important activity of ICCSE would be to seek out opportunities for international collaboration in computer science. Having NSF personnel working in different regions of the world would do this most effectively. NSF should consider opening new offices in different regions of the world, or assigning NSF representatives to embassies in areas where U.S. participation in science and technology is lacking and needs to be increased.

International Science Foundation

Experience shows that establishing joint initiatives between countries requires a great deal of time and effort. Champions must be identified within the funding agencies and research communities in two countries, workshops must be proposed, organized and funded, and the many details of a joint program worked out. Given the time and effort involved, it is probably not practical for the U.S. to establish joint funding initiatives with all countries. Even if this could be a done, joint programs exclude collaboration by scientists from more than the two participating countries. Establishing programs between three or more countries may be possible, but the difficulties probably increase exponentially, and political sensitivities may arise if other countries feel that they are being excluded.

Because a policy of forming bilateral agreements is inefficient (and perhaps ineffective) in promoting internationalization of science and technology, the research community proposes formation of an International Science Foundation, with participation by all nations. This organization would work like the NSF, accepting unsolicited proposals from scientists, or proposals in response to programs and initiatives developed and offered by the Foundation. All proposals, however, would require collaboration by scientists from two or more countries. This model is already followed within the European Union where a variety of research programs have been established with the explicit requirement of international collaboration. These programs have been driven by the creation of the European union. However, they also illustrate the efficiency and effectiveness of an infrastructure that can stimulate, evaluate and fund international collaborative research while satisfying the political and scientific goals of the participating countries.

We believe that the notion of an International Science Foundation has great merit, and could overcome the major barriers to international collaboration. We also believe that this kind of organization will inevitably be created and the time is now for the U.S. to play a leadership role in its definition. In this context, the recommended creation of the ICCSE division is also an important step towards the establishment of an International Science Foundation. The foundations of operational procedures, mechanisms for pooling of international funds and awarding grants can be explored by the ICCSE and International Program divisions of NSF and then transferred to the proposed International Foundation. It is beyond the scope of this report to conceptualize this in detail. If the idea of an International Science Foundation is well received by the research community, we recommend that a separate workshop be organized to consider its principles and organization, perhaps with internationa l advisors.

International Super Centers

Distributed international centers of excellence provide an excellent model for international collaboration. International super centers could be established to advance science and technology in areas of computer science, such as digital libraries, multilingual information management or virtual environments for collaboration, or to solve global problems.

The vision of international super centers is consistent with a recommendation offered by the President's Information Technology Advisory Committee (PITAC). The committee's August 1998 Interim Report recommends establishing Enabling Technology Centers. These are envisioned as centers of excellence that focus on applying information and communications technology to a particular application domain, such as health care, crisis management, environmental monitoring, life-long learning, or law enforcement and public safety. These Centers "will conduct R&D in CS&E to support the chosen application domain, develop new curricula for students and mid-career professionals, participate in testbeds, and identify barriers to more widespread adoption of IT in a particular applications domain." [8]

The NSF is well positioned to assume a leadership role within the U.S. and internationally to promote the establishment of international centers of excellence in computer science and engineering. In recent years, the NSF has developed a number of successful initiatives that require or encourage interdisciplinary and inter-institutional collaboration. For example, the NSF Challenge initiative supported projects that required collaborative research among scientists in several sub-disciplines of CSE to develop technologies or applications of immediate benefit to the nation. The NSF has also supported distributed centers through its Science and Technology Centers (STC) program. For example, the Graphics and Visualization Center (www.cs.brown.edu/stc), one of 24 NSF Centers funded through the foundations STC program, comprises five universities: Brown, Caltech, Cornell, UNC, and Utah. The NSF's International and CISE Divisions could work together, taking advantage of complementary expertise and resources, to extend the model of distributed centers to international super centers.

 

Expand Joint Research Programs in Latin America, and Create New Ones Elsewhere

The NSF should increase the number and scope of joint research programs in developing countries. While we have argued that bilateral agreements are not the most efficient means to promote internationalization of computer science, they can be very effective in specific countries, and should be pursued at increased funding levels until more ambitious multinational initiatives can be implemented. Establishing such programs requires identifying researchers in the U.S. and partner nations who are willing to organize workshops to promote joint research programs.

It is important to find ways to subsidize to foreign institutions to support joint research efforts. We have made the case that this is good foreign policy. In many countries, financial resources are simply not available; amounts as low as $30k to $50k can support students, postdoctoral fellows and faculty in other countries. Presently, this is very difficult to do within the NSF. This investment would enable U.S. investigators to utilize unique resources, and to leverage CISE funding. In many countries, small U.S. dollar investments can make a big difference.

The benefits of U.S. participation in joint research programs in developing countries are illustrated by the success of the NSF / CONACyT program. During the last five years, the NSF and Mexico=92s CONACyT have sponsored three workshops to promote collaboration in computer science between the U.S. and Mexico. Prior to these workshops, there was no division or program within CONACyT responsible for funding computer science. Mexican computer scientists were forced to submit proposals to programs supporting research in Chemistry, Biology, Physics, etc. The NSF / CONACyT workshops, organized by a Principal Investigator at UTEP, with the encouragement of CISE Program Officers of the NSF, helped mobilize the Mexican computer science community. At the most recent workshop, a representative of CONACyT reported that funding computer science is now a top priority within CONACyT. CONACyT has now funded the establishment of centers of excellence at several universities in Mexico.

The NSF / CONACyT program has also demonstrated that joint projects with relatively small capitalization can yield significant outcomes. A collaboration between the Oregon Graduate Institute and the Universidad de Las Americas, Puebla (UDLA) was funded to develop Mexican Spanish language technologies. Prior to this project, there were two faculty with small research programs in language technology. Today, UDLA=92s TLATOA speech group is the largest in Mexico, with twelve faculty, research staff and students. As documented on its Web site the TLATOA group provides language resources, technologies and short courses to other academic institutions in Mexico. CONACyT has funded a center of excellence at UDLA, with speech as one of three focus areas. A U.S. speech technology company has established a subsidiary at UDLA, hired two graduates of the TLATOA group, and has invested over $100,000 in support of the TLATOA group (triple CONACyT=92s original investment). The international research community has also benefited from this effort; Mexican Spanish speech recognition and text-to-speech synthesis systems are now available from the TLATOA Web site.

We recommend that joint research programs, such as those established by the NSF with federal funding agencies in Mexico and Brazil, be initiated in other countries. The amount of the awards in these programs must be increased to attract top U.S. researchers, and agencies should find ways to provide follow-on support beyond initial grants. A seed grant is a good way to initiate collaboration, but there must also be mechanism to support successful collaborations, so they can realize their potential. Follow-on funding is necessary to attract top researchers to international programs. The model could be the successful SBIR program.

Collaboration Model

A model for supporting international collaboration among different countries or funding agencies that is reasonable, consistent and understandable by researchers and program managers world wide is highly desirable. Ideally, it would support training international research teams on the basis of scientific goals and complementary expertise. It would enable groups to seek funding for their work by submitting research proposals to a single agency with the ability to review and fund the proposal. The details of what agencies in different countries should be involved, their deadlines and requirements and other idiosyncrasies should be hidden from the researchers by the agency that receives the proposal.

Funding agencies have a major organizational role to play in this context and should reexamine and reform their inner workings and formal relations with foreign counterparts. Their international funding units should capitalize on the new interest and high priority placed in international collaboration and global efforts. In order to seize this opportunity, they must re-evaluate and revise policies to remove barriers and constraints that were imposed by Cold War attitudes and policies. They have a major responsibility and much of the necessary competence and experience in developing an international collaboration model that reflects the CISE needs in the 21st century.

Market International Programs

Many in the CISE community do not know about existing international opportunities. Funding agencies should market existing international activities and opportunities more aggressively.

Funding agencies should actively encourage researchers to take advantage of opportunities for international collaboration when they can show that such collaboration is appropriate and desirable. In such cases, concrete measures should be used to quantify the benefits of collaboration.

The NSF should develop better reporting mechanisms regarding INT proposals, research results, the investigators and their international collaborators. The information should be collected and made available readily to the CISE community.

It is also important to make the CISE community aware of international activities, such as those of the European Union, including RACE, PACE, ESPRIT, etc. Some of these multinational programs require the participation of universities, industry and government labs, and serve as interesting models for international collaboration.

A good way to promote and market opportunities for international collaboration is to support the development and maintenance of new infrastructure. This could include linked Web sites (similar to the U. of Arizona site on Japan), that identify existing collaborations, areas of expertise in computer science worldwide, opportunities for collaboration, etc. The NSF could provide support for developing this infrastructure by relatively modest funding; e.g., several grants of about $25k to $50k per year.

The importance of international collaboration must also be marketed within funding agencies. Leading officers should encourage and empower program directors to take advantage of existing mechanisms to stimulate and fund international collaborative research.

Further, we recommend that a small delegation of workshop participants make a presentation to leading officers of funding agencies to underscore the importance of international collaboration, and the recommendations herein.

Finally, a follow-on workshop should be held in about one year, to examine the outcomes of the first workshop, and to continue to find ways to support international collaboration in CISE.

Other Institutions and Agencies

Funding barriers to international collaboration could be overcome in several ways.

 

Tools and Infrastructure

International collaboration requires significant infrastructure. Development of infrastructure is essential to successful research. The development of tools to enable international collaboration is a necessary step.

Recent developments associated with projects that are pushing both the state of the art in fast networking and the development of applications enabled by the Internet of the future augur many opportunities for collaboration. These are broadly referred to as the Next Generation Internet and the Internet 2. They have wide support from the government, industry and academia. Fast progress in these projects already enables more than 100 universities to be connected by very fast networks that are to be used for both research and education purposes. While the US has been leading in the push for fast network infrastructure, it is remarkable that several other countries have similar initiatives. Collaborative arrangements between the organizations leading these efforts are already being established. At the time of this writing the Internet 2 has Memoranda of Understanding with countries in Europe, North America and the Asia/Pacific Rim. In addition to the physical interconnection of their networks the participating countries have also agreed to promote the development of applications and to collaborate in the definition of standards that might be needed to make such applications possible.

The international networking infrastructures are essential for both CISE research and international scientific collaboration. Efforts are needed to investigate and develop new classes of applications that explore these infrastructures. Examples of such applications include tele-immersion and virtual collaboratories.

Tele-immersion is defined as collaborative virtual reality over networks, an extension of the "human/computer interaction" paradigm to "human/computer/human collaboration." In this paradigm, the computer provides real-time data in shared, collaborative environments, to enable computational science and engineering researchers to interact with each other (the "tele-conferencing" paradigm) as well as their computational models, over distance. Current tele-immersion research focuses on providing easy access to integrated heterogeneous distributed computing environments, whether supercomputers, remote instrumentation, networks, or mass storage devices using advanced real-time 3D immersive interfaces (http://www.evl.uic.edu/EVL/RESEARCH/art_science.shtml= ).

Virtual collaboratories allow scientists to access and use tools in different geographical locations. The tools can be software for computer-aided simulation and modeling or actual computer-controllable instruments.The computer resources can be distributed and shared across many locations and so can the users. An example of such a system is PUNCH (Purdue University Network-Computing Hubs) which provides web-based access to the use of simulation tools for several CISE and engineering disciplines. It is the enabling infrastructure for the NSF-funded distributed center for advanced electronics simulations (DESCARTES) which includes the University of Illinois-Urbana, Arizona State University, Stanford University and Purdue University. International distributed centers can make use of similar network-computing infrastructures. Similar systems can be develo ped for other disciplines. For example, the Web site at OGI provides a free set of tools and technologies for building and researching spoken language systems in different languages.

Conclusions

The potential benefits of international collaboration justify extraordinary efforts to produce new programs and initiatives, and to explore new models for collaboration and funding. Coordination of resources contributed by other countries and international organizations will have major impact on world problems.

References

1 SCIENCE, TECHNOLOGY, AND THE FEDERAL GOVERNMENT: National Goals for a New Era, Committee on Science, Engineering, and Public Policy, 1993. Available at http://www.nap.edu/readingroom/books/fedtech/ .
2 Bilateral Relations. Available at
http://www.ta.doc.gov/bilat/summary.htm .
3 "Unlocking Our Future Toward a New National Science Policy" A Report to Congress by the House Committee on Science September 24, 1998. Available at
http://www.house.gov/science/science_policy_report.htm and http://www.house.gov/science/science_policy_study.htm= .
4 Opening statement of Congressman Vernon J. Ehlers at Congressional Hearings on International Science, March 25, 1998. Available at
http://www.house.gov/science/ehlers_03-25.htm .
5 International Agreements on Cooperation in Remote Sensing and Earth Observation, Caroline S. Wagner, MR-972-OSTP, RAND, 1998.
6 Caroline S. Wagner, "International Cooperation in Research and Development: An Inventory of U.S. Government Spending and a Framework for Measuring Benefits," Santa Monica, Calif.: RAND, MR-900-OSTP, 1997. Available at
http://www.rand.org/centers/stpi/stp/index.html .
7 Statement of J. Thomas Ratchford, Hearing On International Science National Science Policy Study Committee On Science, U. S. House Of Representatives, March 25, 1998. Available at
http://www.house.gov/science/ratchford_03-25.htm .
8 President's Information Technology Advisory Committee Interim Report to the President, August 1998. Available at http://www.hpcc.gov/ac/interim/ .

Acknowledgements

We gratefully acknowledge the contribution of Dr. Rita Rodriguez, whose energy and vision motivated the workshop and final report. The report benefited greatly from revisions by Allen Klinger, and input from Jerry Engel, Robert Frederking, Hynek Hermansky, Eduard Hovy, Judith Klavans, Rick Schlichting, Don Towsley and Benjamin Wah.

Workshop Participants

Alo, Richard

University of Houston Downtown Ctr. for Computational Science

Anger, Frank

National Science Foundation/CCR

Barnes, Bruce

National Science Foundation/CCR

Beer, Joachim

International Computer Science Institute (ICSI)

Cole, Ron

University of Colorado at Boulder

De Groat, Joanne

Ohio State University

Engel, Gerald

Univ of Connecticut at Stamford Computer Science Eng.

Fortes, José

Purdue University

Fuja, Tom

National Science Foundation/NCRI

Hermansky, Hynek

Oregon Graduate Institute of Science and Technology

Hudson, Jeanne

National Science Foundation/International

King, Willis K.

University of Houston

Klinger, Allen

Univ of California at Los Angeles Computer Science Eng.

Kraemer, Ken

University of California, Irvine

Luperfoy, Susann

The MITRE Corporation

Min, Paul

Washington University

Moura, Jose M. F.

Carnegie Mellon University

Mukherjee, Biswanath

University of California

Ni, Lionel

Michigan State University

Reeker, Larry

National Science Foundation/IRIS

Rodriguez, Rita

National Science Foundation/CDA

Sadagopan, V.

Pace University School of CS Inf. Systems

Schlichting, Richard

University of Arizona

Towsley, Don

University of Massachusetts

Vermeulen, Pieter

Oregon Graduate Institute of Science and Technology

Wah, Benjamin

University of Illinois Coordinated Science Lab

Wittie, Larry

SUNY at Stony Brook

------=_NextPart_000_0006_01BE2411.A8E868C0--