CSCI 539:
Information Retrieval




Week 15

  • Please fill out the course evaluation.   I am genuinely interested to know both what you thought worked and should be kept the same for future students, and what might be improved. The survey is available until Monday or Tuesday of next week. It has been a pleasure, and thank you for an engaging semester of IR study and discussions.
  • Office Hours (Instructor & TA): click on the 'Contact' link above. Office hours will be available through Friday April 29th (i.e., the last office hour over Zoom will be given the morning of our exam).
  • Lectures this week:  On Tuesday, Behrooz presented information about ARQMath and discussed issues pertinent to the final project (slides from Behrooz's talk are available through MyCourses). On Thursday, we will have a discussion about the final presentation (exam) and project submission. 
  • The PyTerrier ARQMath code (pt-arqmath) has been updated, please make sure to download the latest version for use in your project. More information about the lab is available through the ARQMath web pages and the ARQMath forum (Google group).
  • Project / Exam
    • Project group presentations (10 min) will be given in our exam slot, Friday April 29th from 1:30-4pm in our regular classroom (Golisano Hall (GOL)-3445). The exam will be in-person (masked).  Each member of each group should speak for at least two minutes.
    • Final report/paper and code are due the same day (Apr 29) at 11:59pm through MyCourses.
    • Online tool for studying ARQMath topics (by Kiki Ng, UWaterloo): ARQMath Question Browser.
  • Final Paper Summary
    • 3rd research paper summary is due Monday at 11:59pm

Week 14

  • Lecture Reading/Exercises:  ECIR 2021 PyTerrier tutorial python notebooks and slides (link). Slides from a recent presentation given by Jimmy Lin on the evolution of IR and use of transformer models and Neural IR are available through MyCourses.
  • Lectures this week (3): We will meet both Tuesday (Apr 12) and Thursday (Apr. 14) this week to talk about Neural IR and the final project, and meet with Dr. Hamed Zamani at 1-2:30pm on Friday (Apr 15) over Zoom for a tutorial talk on "Conversational Information Seeking." (link: see MyCourses)
  • Project
    • Proposal is due this Friday see MyCourses for requirements. **Machines with GPUs have been provided by the CS department .**  You can find your machine from the list posted in MyCourses.
    • Project group presentations (10 min) will be given in our exam slot, Friday April 29th from 1:30-4pm.
    • Final report/paper and code are due the same day (Apr 29) at 11:59pm through MyCourses.
    • Starter PyTerrier code for the project is here. Please have a look, some updates are forthcoming (e.g., evaluation framework).
    • Online tool for studying ARQMath topics: ARQMath Question Browser. Kiki Ng from the UWaterloo team that did best for Task 1 at ARQMath-1 and -2 created this handy web page. 
  • Final Assignment and Paper Summary
    • A4 is due Tuesday at 11:59pm
    • *Extension* 3rd research paper summary is due Monday at 11:59pm
  • Office Hours (Instructor & TA): click on the 'Contact' link above.

Week 13

  • Lecture Reading/Exercises:  ECIR 2021 PyTerrier tutorial python notebooks and slides (link).
  • **Scheduling Reminder**: We will meet Tuesday (Apr 12) and Thursday (Apr. 14) next week to talk about Neural IR and the project. Also, we will also be meeting with Dr. Hamed Zamani at 1-2:30pm next Friday (Apr 15) over Zoom for a tutorial talk on "Conversational Information Seeking." The link for this additional meeting is available through MyCourses.
  • Grading for the 2nd Paper Summaries will be available by Friday.
  • Deliverables:
    • The final quiz (Quiz 10) will be given this week! 
    • Assignment 3 is due Tuesday at 11:59apm
    • *Extension++* 3rd Research Paper summary due Thursday (Apr 14) at 11:59pm.
    • *Extension* A4 is now due Tuesday at 11:59pm.
    • *Extension* Project/Exam: The project details have been posted (proposal is due next Friday, Apr. 15). Grading rubrics for all project components may be found under "Assignments" in MyCourses. Sign up to join your project group using the "Groups" menu on MyCourses (by Apr. 15, 11:59pm). Students will be assigned automatically to groups after that date. 
    • ARQMath Data/Code for use with PyTerrier will be available by Friday evening (earlier if possible).
  • Office Hours (Instructor & TA): click on the 'Contact' link above.

Week 12

  • Readings:  Croft Ch. 7 (particularly 7.6, on Learning to Rank); ECIR 2021 PyTerrier tutorial python notebooks and slides (link).
  • Deliverables:
    • Quiz 9 out, due Friday at 12pm. 
    • Assignment 3 has been released (due *Tues* Apr. 5)
    • Project proposal requirements are available through MyCourses, and are due next Sunday (Apr. 10). Sign up to join your project group using the "Groups" menu on MyCourses (by Apr. 10)
    • Research paper 3 (on ColBERT) is available on MyCourses, along with a paper on the MS MARCO dataset used in the paper (leaderboard). We will this Thursday of Wk 13, with summaries *also* due Sun, Apr. 10.
  • Office Hours (Instructor & TA): click on the 'Contact' link above.

Week 11

  • Schedule Change (Wk 14): We will have a talk from Hamed Zamani (UMass) on conversational search on Friday, April 15th at 1pm. There will be no class on Thursday of that week.
  • Schedule Note (Wks 14 & 15): Tuesday of Wk 14, Thursday of Wk 15 class will be used for open discussion / problem solving for the final group project.
  • Readings:  Croft Ch. 7 (particularly 7.6, on Learning to Rank)
  • Deliverables:
    • Quiz 9 will be available Wednesday, due before class on Thursday 
    • Assignment 3 and the Project Specification and Proposal will be released this week (due Apr. 3)
    • Research paper 3 (on ColBERT) is available on MyCourses, along with a paper on the MS MARCO dataset used in the paper (leaderboard). We will discuss the paper on Thursday of Wk 13, with summaries due Apr. 10.
  • Office Hours (Instructor & TA): click on the 'Contact' link above.

Week 10

  • Readings:  Croft Ch. 7 (Retrieval Models)
  • Deliverables:
    • Quiz 8 will be available by Wednesday morning, and due before class on Thursday.
    • Assignment 3 will be released soon, and be due Sunday Apr. 4.
    • Requirements for the group project proposal will be posted next week. Start thinking about who will be in your group (groups of 3)
  • Office Hours (Instructor & TA): click on the 'Contact' link above.

Week 8

  • Enjoy the break next week!
  • Some changes have been made to the schedule.  Please see the link above for details.
  • Readings:  Croft Ch. 7 (Retrieval Models)
  • Deliverables:
    • Quiz 7 will be available Wednesday morning, and due before class on Thursday.
    • (*Update*) Assignment 3 will be released the after break.
  • Office Hours (Instructor & TA): click on the 'Contact' link above.

Week 7

  • Readings:  Croft Ch. 6 (Queries and Interfaces - for time, skip 6.2.5, 6.3.2, 6.3.3 and 6.4)
  • Deliverables:
    • Quiz 6 will be available Wednesday morning, and due before class on Thursday.
    • The second research paper is available from MyCourses. We will discuss the paper in-class on Thursday. Paper summaries are due this Sunday, Feb. 27 at 11:59pm.
    • Assignment 3 will be released by Thursday, and be due Sunday, March 6 at 11:59 pm.
  • Office Hours (Instructor & TA): click on the 'Contact' link above.

Week 6

  • Readings:  Croft Ch. 4 (text statistics and processing)
  • Deliverables:
    • Quiz 5 is due at 11:59pm on Thursday. 
    • Assignment 2 is due this Sunday, Feb. 20, at 11:59 pm.
  • The second research paper will be posted on MyCourses before the weekend.
  • Assignment 3 will be posted next week.
  • Office Hours (Instructor & TA): click on the 'Contact' link above.

Week 5

  • Readings:  Croft Ch. 5 (inverted indices and Boolean retrieval)
  • Deliverables:
    • Quiz 4 will be out Wednesday, and be due before class on Thursday
    • Assignment 2 will be released Monday, and be due Sunday, Feb. 20, at 11:59 pm
  • Office Hours (Instructor & TA): click on the 'Contact' link above.

Week 4

  • Readings:  Croft Ch. 5 (inverted indices and Boolean retrieval)
  • Deliverables:
    • Quiz 3 will be available by Wednesday morning, and will be due before class on Thursday. Answers to the previous two quizzes are available through MyCourses.
    • Assignment 1 is due this Sunday, Feb. 6, at 11:59 pm.
  • Assignment 2 will be posted before the start of class next week.
  • Office Hours (Instructor & TA): click on the 'Contact' link above.

Week 3

  • Answers for Quiz 1 have been posted on discord and in MyCourses.
  • Readings:  Read Hearst Ch. 2 (Search UI Evaluation), and Croft Ch. 8 (Evaluating Search Results)
  • Deliverables:
     
    • (1) Quiz 2 will be available Wednesday morning & due before class on Thursday,
    • (2) your 1-page summary of the AdNauseum paper is due this coming Sunday (Jan 30) at 11:59pm, and
    • (3) Assignment 1 is due Feb. 6th at 11:59pm (next Sunday) -- make sure to review and start the assignment early, and share your questions over email, discord, or during office hours this week.
  • TA Office Hours:  In addition to Prof. Zanibbi's office hours, our TA Behrooz Mansouri is holding office hours via Zoom Tuesdays 12-1pm, and Thursdays 3-4pm. Links for office hours are available through Zoom.  See the 'Contact' link above for additional information.

Week 2

  • Readings:  Read Croft Ch. 1, and Hearst Chs. 1 and 3. For next week, read Hearst Ch. 2, Croft Ch. 8 (on evaluation of search UIs (Hearst), and search results (Croft)).
  • First research paper posted (AdNauseum). We will discuss this paper in-class on Thursday of Wk 3 (i.e., next week). The 1-page summary, in the format outlined in the IR-Paper-Summaries-v1 document under 'Readings' on MyCourses is due Sunday, Jan 30th at 11:59pm. Papers should be single-spaced.
  • Quiz 1 will be available by Wednesday morning, and will be due before class on Thursday.
  • Assignment 1 will be available by Monday morning of Week 3.
  • Please make sure to sign up for the class Discord server if you have not already; information on how to join the server is provided in MyCourses.

Week 1

  • Readings:  Please read Ch. 1 in the Croft et al. and Hearst textbooks (available through MyCourses). We will discuss Hearst Ch. 3 in Week 2.
  • First research paper posted (AdNauseum). We will discuss this paper in-class on Thursday of Wk 3. The 1-page summary, in the format outlined in the IR-Paper-Summaries-v1 document under 'Readings' on MyCourses is due Sunday, Jan 30th at 11:59pm.
  • Welcome to the web pages for the IR course being offered by the Department of Computer Science at RIT in Spring 2022.
  • Prof. Zanibbi is the course instructor, and Behrooz Mansouri is the TA for the course.
  • Lectures are Tuesdays and Thursdays from 2:00pm - 3:15pm in Golisano Hall (GOL) 3445. Due to the ongoing COVID situation, lectures will both be in-person and over Zoom, and lectures will be recorded. Lecture attendance is strongly recommended, whether online or in-person. 
  • These web pages will be used to communicate information about the course, along with news, deadlines, etc.  Assignments and projects will be distributed and submitted using MyCourses.
  • There is also a Discord server for this course; information on how to join the server is provided in MyCourses.