AI and the Mathematician

At the beginning of this year, I went to the Joint Mathematics Meetings, JMM 2025. JMM is the largest annual meeting of mathematicians worldwide. Each year, JMM has a special theme, and this year, it was "We Decide Our Future: Mathematics in the Age of AI." That means that in addition to all the regular sessions where talks are given on various mathematical topics, special thematic talks and sessions on AI were also included.

my photo of the balloons at the entrance of JMM

I was privileged to have been invited to give two talks. My first talk was a regular short talk on a result related to combinatorics and machine learning. My second talk was an hour-long talk for a more general audience in a special session called "AI for the Working Mathematician." The main organizer of the special session was Akshay Venkatesh, a Fields medalist in number theory. He's not an AI researcher, but he's thinking about these issues along with many others.

This second talk of mine got a lot of enthusiastic feedback in the form of follow-up emails and discussions, so I want to write down some of my thoughts from that talk. A link to the talk slides is here. The short summary is:

1. We are already at the point where machine learning is already useful for research mathematics, both as structured systems (e.g. Copilot Lean) and as general LLMs (e.g. GPT-o1) -- I gave examples of both.
2. In most cases, the time period between when machine learning starts to be able to do tasks and when it overtakes humans is usually short, so we should enjoy the current "golden age of mathematics," which has already begun.
3. The claim that math is inherently different from other endeavors where AI has taken over isn't well supported. We begin with ZF/C (start position) and need to arrive at a theorem (winning position) using logical deductions (legal moves). How is this fundamentally different from chess? (This is related to an observation made by Matus Telgarsky in his excellent talk.)
4. We are very far behind in understanding Deep Learning, and we will remain so for cutting-edge systems. Perhaps one hope of catching up is if we use AI systems to help ourselves understand them.
5. There is still a role for mathematicians to play in advancing the state of the art: machine learning reductions come to mind as one place where we can still make theoretical advances that are useful.

But for how long can we be useful is unclear. Time will tell, though I'm not optimistic about humans being at the forefront of math research forever. The theme of JMM 2025 claimed, "We decide our future," but for how much longer?

Updates from 2024

Another year ends. Here are some updates from my end and also some thoughts. 

• I’ve become director of IDEAL for this year (and will take my sabbatical the following year as my reward). I’m happy to note that Avrim Blum and I are hosting Idan Attias as a postdoc at the institute. We’ve started working on some interesting problems on learning-augmented algorithms, and he’s working on many other interesting things with various people at UIC and TTI-C. 

• My student Jake Maranzatto finished his Ph.D. this year and has started a postdoc with Sennur Ulukus at the University of Maryland. In his dissertation, he solved a variety of interesting problems at the intersection of combinatorics and information theory. You can read it here. 

Hooding Jake at the UIC commencement. 

• Two progenitors of the deep learning revolution won the 2024 Nobel Prize in Physics, and scientists employing machine learning won the 2024 Nobel Prize in Chemistry. I understand the chemistry prize, but it took me a while to come up with a theory of what happened with the physics prize. The best explanation I can come up with is that physics, which is considered less exciting these days, is attempting to share in the credit for some of the most groundbreaking advances in computer science.  

• On a related note, AI continues to upheave many fields, including math, and I’ll be discussing some of that at the JMM next week in Seattle, where AI is the overarching theme. Deepmind's latest specially-trained software can already achieve silver-medal performance on the IMO. How long will it be until a future such system makes real progress on research problems? (I'm guessing not that long.)

• I am quite excited to say that I’ve agreed to become the Editor-in-Chief of a new top-level diamond-access journal published by the AMR at the intersection of mathematics and data science, machine learning, and artificial intelligence. Stay tuned for official info on this new venture soon. 

• Culminating a decade-long project, the brain of a fruit fly was completely mapped. This was done with the help of AI, and this result might also help advance AI by giving insights into (natural) neural networks.  I have a feeling there will probably be interesting things to post about AI every year.

Neurons in the fruit fly brain, by Philipp Schlegel

• Donald Trump has been elected President for a second time. There is, of course, always much to say about him, but I'll stick to academia/science here. There, I hope to see Title VI better enforced against universities (including my own) with respect to antisemitism, a reduction of DEI initiatives at the NSF and other funding agencies, and a renegotiation (downward) of overhead rates on grants. I’m, of course, not holding my breath for getting all three. And I’m not even listing the elimination of federally-backed student loans because that would take an act of Congress, and they don't seem likely to act.

Wishing everyone a happy New Year's celebration, and then it's on to 2025!

On The Beginning of Infinity

Here's my review of "The Beginning of Infinity," a book that touches on many of my interests. Its author advocates a philosophy that's much closer than that espoused by the author of the previous book I blogged about.

---

The Beginning of Infinity: Explanations That Transform the World by David Deutsch
My rating: 5 of 5 stars

The Beginning of Infinity presents a strong thesis about the importance of explanatory knowledge and its relationship to limitless progress. I’d heard Deutsch talk about this topic before, and I had assumed this would be yet another typical nonfiction book belaboring the same points. A friend whose tastes I respect recommended I read it anyway, so I gave it a try. I’m very glad I did!

The books thesis in clearly laid out, and the arguments for it are very persuasive. Deutsch confronts many possible philosophical objection, and attempts to obliterate each one by using very general arguments. He convincingly takes on inductivism, empiricism, justificationism, relativism, instrumentalism, and of course post-modernism, among many other philosophies. In fact, his arguments against other philosophies are probably stronger than his argument for his own thesis, but I think that still fits with the main worldview of the book: that progress requires replacing mistaken ideas.

Deutsch reinforced many of my views on some topics (eg the existence of objective values) and convinced me of some others (on why political compromise is bad). Even in parts of the book where I found him less convincing (eg in his defense of the many-worlds interpretation of quantum mechanics or his views on AI), I feel I still learned something and have more to ponder.

I also appreciated Deutsch’s fearlessness. For example, he doesn’t buy into environmental sustainability and is willing to buck most academics on sacrosanct topics. You know where Deutsch stands and why. Go read this book if you have any interest in the philosophy of science and of human progress.

View all my reviews

The First

I haven't posted any book reviews on this blog, but since this one is relevant to academia, I thought I'd give it a try. Here's my first posting of a review I wrote on goodreads.com.

---

The First: How to Think About Hate Speech, Campus Speech, Religious Speech, Fake News, Post-Truth, and Donald Trump by Stanley Fish
My rating: 4 of 5 stars

I started my faculty job at UIC in 2012, eight years after Stanley Fish finished his term as dean of my college, and it didn’t take me long to hear about him. I heard about Fish before I knew the name of my (then) current dean, and I never even learned the names of other former deans. Usually, when an administrator becomes so memorable, he must have done something disastrous that nobody can forgive. But as far as I understand, this was not the case with Fish; he was known for making bold and unusual decisions, often controversial but not inept.

Now, twelve years later, I was at a used book sale where I saw a book by someone named Stanley Fish. Seeing that name jogged my memory, and I checked the author’s bio to see if it was the same Stanley Fish — indeed, it was! I had no idea he wrote books (apparently, he wrote many), and I immediately bought the book to see what he had to say.

The book involves the author expounding his ideas on the First Amendment, and it did not disappoint. True to his reputation, Fish takes many controversial positions— including that freedom of speech should not be the central value on college campuses and that the First Amendment should not have included religion — and he even offers the best defense of postmodernism that I’ve seen. (I still don't buy it.)

In the end, this is a fun and thought-provoking book. It reinforced my views on some things, convinced me on some points, and utterly failed to convince me on many others. But unlike most non-fiction, this book delivers something new and unpredictable with each chapter.

The main downside is that the book feels like a rant more than a principled argument spanning the various aspects of the First Amendment. The long title even betrays its lack of coherence. The other downside, of course, is that I think he’s wrong about too much! Still, it was a fun read.

View all my reviews

Looking Back on 2023

It's time to look back on another year. Russia's invasion of Ukraine loomed large over 2022, but for me this year was overshadowed even more so by the October 7th massacre in Israel.

• Immediately after the brutal attack on civilians orchestrated by Hamas from Gaza, protests started against Israel (yes, against Israel, not against the perpetrators) and against the Jews generally. College campuses were at the forefront of this trend, where chants like "from the river to the sea" and "globalize the intifada" broke out en masse. One would think that universities that have been disciplining members of their communities for microaggressions would have at least been able to condemn such hateful demonstrations, but they suddenly found their "deep commitment" to free speech when it came to calls for the annihilation of Jews. Their hypocrisy on this matter was nicely exposed by the congressional testimony of the Presidents of Harvard, MIT, and UPenn. UPenn's president Liz Magill's smirking answers were so disastrous that she had to resign shortly afterwards.

Hamas supporters at Columbia University

• The controversy didn't end there. The hypocrisy at Harvard was especially glaring because Harvard is both the country's most famous university and simultaneously manages to come in dead last in FIRE's free speech rankings. The president of Harvard, Claudine Gay, has a record of persecuting academics whose political views she disagrees with. Her conservative critics found this an opportune moment to surface allegations of plagiarism against her, and subsequent investigations revealed evidence of dozens of instances of plagiarism -- she even plagiarized some of the acknowledgments in her Ph.D. thesis! For now, Harvard continues to stand by her, pretending she's merely responsible for some instances of "duplicative language." But every passing minute that she remains at its helm continues to expose Harvard's double standards. If she's fired, it will be a blow to the DEI system that she helped build up and from which she seems to have very much benefited, and if she's retained, it will be a blow to Harvard's reputation for academic seriousness. I call this a win-win for us critics of universities that have so clearly lost their way.

• Moving on to happier matters, Saeed Hajizadeh finished his Ph.D. at UIC this year. He works mainly in the field of mathematical optimization, and he is currently working for Roosevelt University as a visiting faculty member. Saeed was technically my student, and I did follow his research progress, but his area was sufficiently far from mine that his primary (unofficial) advisors were Haihao Lu (at UChicago) and Benjamin Grimmer (at JHU).  Congrats to Saeed!

Saeed and myself after his defense

• After ALT 2023, I was elected to chair the Steering Committee of ALT. It's a conference I've long been involved with in various roles, and I'm gratified to be able to continue to work to improve it. I also will have a paper in ALT 2024 (in case you think the SC chair gets special treatment, my other submission was rejected!), so it will be nice to be able to attend the conference for two separate reasons.

• I was the main organizer on the special session on machine learning and logic (in Spring 2023) at the IDEAL institute.  It was an exciting semester, with many events, and you can read more about them in these articles. My research also directly benefitted, as this paper came about as a result of a particularly stimulating problem session.

• On a personal note, I did a pretty exciting thing and competed in the kettlebell sport world championships in the long cycle event this year.  I've been doing kettlebell seriously for several years now, and this year I (barely) made the US National team -- this involved traveling to USKSL Nationals and qualifying. Not only did I get to go to IUKL worlds in Uzbekistan, I am also very happy with how the competition went for me, as I set my personal best there by quite a margin.

me lifting at IUKL worlds in Khiva, Uzbekistan

• Finally, my discussion of 2023 wouldn't be complete without again mentioning large neural network-based language models. At the end of last year, ChatGPT impressed us all.  In 2023, it has become a regular part of many people's workflow.  I also occasionally use it for work: for giving me ideas for exam questions, catching grammar mistakes, and helping me code when I need to create a simple program.  This trend seems destined to continue into 2024 and beyond, as is its impact on society. But where it's ultimately headed, we really don't know despite some confident predictions.

With wishes for a happy and peaceful 2024.

Good Riddance to a Bad Policy

Since this is an academic blog and I am a university professor, I ought not to forgo commenting on the large legal bombshell that just dropped on American higher education.  I am, of course, referring to the ruling in Students for Fair Admissions, Inc. v. President and Fellows of Harvard College and Students for Fair Admissions, Inc. v. University of North Carolina et al.

Admissions offices: Harvard's (left) and UNC's (right)

I summarized my views on Twitter, and I'll repeat them here:

I think this decision ending "affirmative action" is basically right on the law. In my view, explicit racial considerations clearly violate Title VII. Affirmative action admissions policies also, at the very least in the case of public institutions, clearly violate the 14th Amendment.

The Supreme Court went a bit further and said that for both types of institutions, explicit consideration of race violates the 14th amendment. That seems to imply that even in the unlikely case Title VII were to be repealed, affirmative action would remain illegal everywhere. Practically, however, the result is the same as under my reading because Title VII is here to stay. Explicit consideration of race will no longer be allowed in college admissions. 

As an aside, I actually wouldn't mind trying a system where public schools were bound by race-neutral measures, but private schools were allowed more flexibility -- not just with Title VII but with other laws too. That was of course never going to happen and can't happen for even more reasons now. 

Of course, many schools will still try to achieve a target racial balance by getting rid of the SATs and other objective measures that may catch them discriminating.  They may even pull out of rankings to try to hide the hit to their reputations. But elite institutions can only do so much of that without losing many good students to their competitors and therefore their prestige over time.

In the end we should strive to judge people as individuals, on their merits and perhaps their hardships. These considerations may of course may correlate with race, but blindly using race as a factor creates many more problems than it fixes.  So I think this ruling is a big step in the right direction and am hopeful that a fairer system will emerge.

Reflections on 2022

As we reach the end of another year, it's time for me to continue the tradition of posting some reflections. Russia's unjust invasion of Ukraine loomed large over this year, especially for those of us with many connections to both countries. There's too much to say, so I'll keep my comments limited to the fact that I am heartened by most of the world's support of Ukraine and by academia's attempts to mitigate the war's effects on its small corner of the world.

Now for more provincial concerns:

• UIC's Phase I Institute, which I have directed for the last 3 years, together with NU/TTI-C/UC's Phase I Institute and IIT, applied for and received $10M of Phase II NSF funding. The resulting expanded institute will have lots of exciting programs, including on "Machine Learning and Logic" next semester. We also have some postdoc openings, and there is still time to apply. Visit our website at http://ideal-institute.org/.

 

an image of IDEAL's website

• This year, I graduated my first Computer Science Ph.D. student, Neshat Mohammadi (co-advised by Tasos Sidiropoulos); all my previous students were in Mathematics. Her unconventional career path now takes her to Stanford Medical School for a postdoc; I will follow her progress with interest. With Will Perkins, I also co-hosted a postdoctoral fellow, Aditya Potukuchi, who took a tenure-track position in EECS at York University. Congratulations go to them both!

• ChatGPT was recently released, causing quite a stir in my community. It's scarily impressive. I used to believe that neural networks would only take us so far before we have to invent new methods to progress toward AGI, and while that may still be true, they've already taken us further than I expected and show no signs of stopping anytime soon. Of course, ChatGPT has many failure modes, and no, it doesn't have the actual "understanding" that humans do, but I am amazed that some skeptics can only find things to criticize in this new technology. It reminds me of this.
  

a ChatGPT-created riddle that I enjoyed, with a correct solution

• My alma mater continues to disappoint me. This year's most worrying development was Princeton's firing of renowned classicist Joshua Katz, under a transparent pretext, for his arguably immoderate speech that nonetheless should have obviously been protected. Despite my increasing unease with Princeton's policies, I had dutifully donated to them every year, but no longer. On occasion, we still get glimmers of hope from academia, but overall, the situation remains bleak.
• NASA's James Webb telescope started producing images this July, and they are astounding. I look forward to enjoying its constant stream of beautiful pictures in the coming years. 

an image of Jupiter obtained by the James Webb Space Telescope (provided by NASA)

• Academia is slowly relaxing its most restrictive COVID measures. This year, even UIC, which seems to have some of the most draconian policies among American universities, allowed its faculty to give lectures unmasked (to a masked and distanced audience). This was not an option many of my colleagues chose to exercise, but I, for one, appreciated being able to better vocalize (and breathe).

I enjoyed attending ALT 2022, which was my first post-COVID international conference. It was held in France at the fabled ENS-Paris. I'm looking forward to continuing to be able to attend conferences next year.

ENS Paris

Here's to a peaceful, healthy, and productive 2023!

As 2021 Ends

Another difficult year ends, this time beginning and ending under the shadow of the COVID pandemic, with no end in sight. Vaccine and booster requirements are only intensifying, masks mandates are still in effect, and many institutions, including my own university, are even starting 2022 online. We won’t return to normal until we decide it's time to start treating COVID less as a pandemic and more as an endemic virus that is here to stay, like the flu (whose dangers have lessened with exposure and time).

In the meantime, here are some other thoughts on this last year.

• Over the summer, I got promoted to the rank of Full Professor. I’ve said the main things I wanted to say in a Twitter thread. You can read it here.

• The ISAIM 2020 special issue of the journal AMAI, which I guest-edited, will come out in January. Despite the pandemic slowing things down, we completed the submission process, the reviews, gathering revisions, and finalizing publication of this issue in less than 2 years -- my issue foreword is already online.  On a related note, you can still register to attend ISAIM 2022 virtually January 3rd through 5th.

• I taught my courses in 2021 in “hybrid” mode. For me, teaching in a mask (as required by UIC) was difficult and frustrating, especially when trying to cater to an in-person and online audience simultaneously.

• I co-organized a machine learning theory workshop at the Chicago-based ISMI institute.  The talks were awesome and are available online. Also, I started dabbling in drawing and decided to sketch a portrait of each of our organizers and invited speakers, but fearing causing unintended slight, I kept these private since the event. I have now changed my mind and am posting them below. But please attribute anything you may unflattering in your portrait to my lack of drawing ability and not to ill intent.

my hand drawing of the IMSI ML Workshop organizers and attendees

• My employer, UIC, has intensified its misguided policies with respect to basic faculty rights. Not unrelatedly, I have suspended donating money to various UIC funds and have instead begun donating to FIRE. I am also pleased to say that I have joined the AFA by invitation. I am thankful for the existence of these organizations and want to do what I can to help the cause of academic freedom.

• About a year ago, fifty established researchers (including a Turing award winner and other very famous people) sent an open letter to the CACM. After acknowledging the letter’s receipt, the CACM went on to ignore it, neither publishing it nor rejecting it, and not even replying to our inquiries about its status. I can only surmise the magazine could not publish it without risking a woke backlash or reject it without embarrassing themselves. After waiting what I think is an appropriate amount of time, I decided it best to make it known what course of inaction the CACM has chosen. (Also see my 2020 end-of-year post.)

• My former Ph.D. student Ben Fish started a tenure-track position at the University of Michigan this fall. Not to put any pressure on him or anything, but I am now eagerly awaiting academic grandchildren. (Is this how some parents feel after their children get married?)

Wishing everyone a happy and healthy 2022!

Done with 2020

We finally made it to the end of 2020! I found myself thinking recently about how long the year felt and was reminded that Trump's impeachment trial happened at the beginning of 2020 and Biden's upcoming inauguration will take place less than a year after.  It is a bit hard for me to reconcile this observation with how I experienced the flow of time this year.

• I'll begin with COVID-19 since starting with anything else would seem strange to me. Too many people, including those who started 2020 on a healthy note, didn't make it to 2021.  Over 350k Americans died of the coronavirus, which means that many of us (myself included) lost a friend or family member to this disease.  When this pandemic is over, I hope we can all learn some lessons for the future.  I have my own thoughts on what we did well, what we did badly, etc., but perhaps this post is not the right place for them.  For now, I will simply express hope that the newly made mRNA vaccines turn out to be as safe and effective as predicted.
  
  
• One positive side-effect of the pandemic is that technology allowing people to work remotely seriously improved during the lockdowns.  When I switched to teaching online in Spring 2020, I had to improvise and hated it. But by Fall 2020, I ran two courses remotely, obtained the necessary tools to make the process smooth, and even learned to enjoy teaching online. Many companies had to go remote during this year and are now considering staying completely remote going forward. This may allow more people disentangle where they live and where they work (and perhaps precipitate the collapse of Silicon Valley as the undisputed technology capital of the US). Another positive side-effect, at least for me, was that being locked-down gave me more time with family and allowed time for new hobbies and for more reading.
  
  
• I've been optimistic about the prospect of medical sciences making significant advances in the next few decades for improving human healthspans (and lifespans), but I had been less optimistic about the ability of ML and AI to seriously help in this endeavor. AlphaFold, a product of DeepMind using technology it developed earlier, has made drastic improvement on the problem of protein folding. I was pleasantly surprised by the result and have thus also become more positive in general on the ability of machine learning to have a real impact on medical science in the future. Read about it if you haven't already!

image from DeepMind's Nature article

• I have been fortunate to advise and graduate wonderful students, and this year was no exception. My student Shelby Heinecke defended her Ph.D. (online!) and began work as a Scientist at Salesforce Research, a rather young lab that has grown impressively over the last several years.
  
  
• I helped draft a letter to the Communications of the ACM expressing concern over the growing cancel culture and pleading for allowing for vigorous argument over ideas.  We released it to the public a few days ago, on December 29th.  The letter was quite anodyne but already caused the predictable reaction, which only served to reinforce the idea that such a stance very much needs to be taken. If you are an established professional in the computing sciences, there is still time to sign it before we send it to the CACM.
  
  image of CACM open letter

After a long summary for last year, that's all I have this time around.  But I am glad to be done with 2020.  

Here's to a better 2021!

A Look Back on 2019 and on the Decade

Today not only ends the year but also (putting debates aside) the decade.  Before I reflect on this last year, I wanted to also take a look back at this last decade.

I began the previous decade (the 00's) as still a teenager, soon to graduate from high school and ready to set out for college, and I ended it by getting married and with receiving my Ph.D.  That amounted to a lot of personal, academic, and professional change and growth.

This decade (the 10's), I also feel I have a lot to be thankful for and frankly proud of.  In the last ten years, my wife and I had (and have been raising) two wonderful kids; we moved to Atlanta then to Chicago (where we bought a house); I completed two postdoctoral positions (one at Yahoo! Research NY and one at ARC at Georgia Tech); I got a tenure-track faculty job at UIC (and then tenure) and took my first sabbatical (at Northwestern); I obtained some interesting (at least to me!) results with fantastic collaborators and in the process (co-)authored about 30 papers; I mentored 6 amazing Ph.D. students and postdocs; and I incorporated the non-profit AALT and remain very active with it.

It feels strangely self-congratulatory, but I think it's good to reflect on one's life and achievements on occasion, and the end of a decade is not a bad time.  In sum, I consider myself quite fortunate, and I look forward to the adventures and opportunities the next decade will bring!

A photo I took of downtown Chicago, the city I've come to call home this last decade.

Now, on to some 2019 highlights, where I cannot seem but help to delve into some of the latest controversies:

• A group of us at UIC were awarded an NSF TRIPODS grant to start an Institute on the Foundations of Data Science.  UIC even put out a press release.  (In this coming decade, I expect it will take up quite a bit of my time as its director.)  Our first activity will be an open house on January 17th -- all are welcome to attend, and you can register for the open house here.  Later, UIC, with the involvement of the new institute will host the Midwest Machine Learning Symposium (MMLS) in 2020.  

• My student Mano Vikash Janardhanan defended a very nice dissertation this year on graph learning, which was the topic of my own Ph.D.  Mano is now doing well as an applied research scientist at Lifion by ADP.  I should also note that my former student Benjamin Fish is currently on the research job market -- he is great and you should hire him if you can.

• UC Davis Mathematics Department Chair and Professor Abigail Thompson wrote "A word from..." in Notices of the American Mathematical Society (AMS) criticizing the use of diversity statements.  (She later wrote a very nice op-ed in the Wall Street Journal.)  Her message compared how the University of California system evaluates diversity statements to political litmus tests during the Red Scare.  I agree with the concern that diversity statements will mainly serve to filter out conservative applicants and will further discourage diversity of thought, which should be among the central concerns for universities.  I was and remain concerned at the attacks against her, and I was proud to be among the many to sign onto a letter ("letter to the editor," p. 9) in her support.
  
  
  
  Signatories of a different letter ("the math community values a commitment to diversity," p.2) criticized the Notices for publishing her piece -- I found that letter troubling, not only because of its assumptive claim of speaking for "the math community," but also for its apparent position that opposition to diversity statements contradicts AMS's policy supporting diversity.  Not only does Thompson support diversity, but even if she didn't, disagreeing with any given policy does not mean violating that policy per se.  Policies can recommend courses of action or express commitment to certain goals, but policies should not forbid people to disagree with them.  If the AMS does not wish to become a laughingstock (or a Church), it should refrain from declaring infallibility on any of its positions. (If it were against any policy to oppose it, we would not be able to revoke any current policy in the future.  Surely, that's not a reasonable position.)

• The Association for Computing Machinery (ACM) apparently signed on to a letter opposing a proposed policy of making all federally funded research publicly accessible.  This is not an issue I am deeply informed on, but my initial take is that there is no reason for federally funded research not to be open to the public (unless national security or clearance issues are involved).  When we have arXiv, journals simply do not seem to provide enough value to warrant limiting access (consider e.g. "overlay journals").  This seems to be an issue of a professional society protecting its interests (the ACM limits access to some of its publications) over those of its members.

• I've discovered the Goodreads site and app, which lets me keep track of my reading, rate books, and set reading goals.  I can't recommend it enough.  It's one of the only apps that reminds and motivates me to spend my time well (on reading) instead of wasting it online.  I recommend you try it too, especially if you have reading goals or resolutions for the upcoming year.

• As many of you know, in 2018 there was a move to rename the Neural Information Processing Systems conference. After much debate and a confusing process, the conference was not renamed, but its acronym was changed from NIPS to NeurIPS going forward. Controversy around this renamingacronyming reignited when Scott Aaronson, on his blog, posted an email by Steven Pinker politely expressing his view that the renaming was a bad idea. I do not want to get into the latest debate, but I want to point out that subsequently, on a widely read twitter thread, Pinker was accused of "sexist behavior" for writing the email, and he and Aaronson were accused of "shutting down marginalized voices" just for stating or publishing an opinion.  Baselessly accusing Pinker of sexism is a bullying tactic that's meant to scare him and others less famous than he is into keeping quiet (which is ironically one of the accusations falsely leveled against him).  Regardless of the side we take in these debates, we should roundly reject the use of such tactics in arguments in the academic community.

• I am the PC chair of ISAIM 2020, which begins on June 6th of 2020 in Fort Lauderdale, Florida.  We accepted some very nice papers, and we will have several exciting invited talks.  I have been attending this biennial conference since 2014, and it will be the first conference I attend this year.

• Related to my areas of research, my department is hiring a very well-funded postdoc in data science and a tenure-track faculty member in mathematical computer science. It is not too late to apply for either position, so please consider us! We have a strong theory group that’s continuing to grow.

2018 in Review

The best thing about establishing a tradition of blogging at the end of the year is that it compels me to write down some thoughts.  So, here they are, in no particular order:

• My very talented student Ben Fish graduated this year and is now doing a postdoc at the newly established Microsoft Research Montréal.  In his dissertation, he developed interesting new algorithms for modern data analysis, and I eagerly await the impactful work he'll continue to produce.

• I am on sabbatical at Northwestern until Fall of 2019.  I'll be teaching a graduate class this Winter quarter and probably another one in Spring.  I've realized I'm probably happiest while teaching one course, so that's the situation I've arranged for myself.  I'm also of course excited to be in a new environment and to interact with Northwestern's fantastic group of faculty and students.

Mudd library: home of Northwestern CS and where I'll be most of next year. (Photo by me.)

• There has been recent activity connecting logic to machine learning.  A nice paper by my colleagues at UIC relates concepts in model theory and concepts in computational learning theory.  Another interesting paper gives a machine learning problem that's independent of ZFC; I've written a Nature News and Views piece about it, which should appear sometime soon (update on 1/18/19: my paper is here).  In general, I am excited to see where these directions lead.

• I really enjoy attending the ALT conference because unlike some of the huge machine learning conferences, it is a relatively small and intimate gathering, where it's possible to get to know fellow attendees and actually have time to discuss ideas.  In addition to chairing the local planning as ALT arrives in Chicago for 2019, I've also been leading an effort to build a legal structure around the organization of ALT.  And this November, AALT, the Association for Algorithmic Learning Theory, became incorporated as a nonprofit.  It's been a lot of work, and I'm not yet done, but it's also been very rewarding to help ensure the future of a conference I've become very fond of.  I'm also excited to see ALT improve year after year, while it continues cover a broad array of topics within learning theory.

ALT 2019 will be in Chicago.  (Photo by Allen McGregor.)

• I continue to worry about illiberal values gaining ground in higher education, where more and more dogmas cannot even be questioned. This trend is increasingly affecting the sciences and even applied mathematics.  The best defense that I see is for what I really hope is the majority of us who do value a diversity of ideas to speak out, and the more who do, the less risky it will be.  Outside higher education, there are also many reasons to worry, but one bright spot is the fairly new Quillette magazine, which has been fearlessly publishing thoughtful articles on controversial topics, including ones concerning academia.

• In my last year's post, I advocated for conferences to make changes to address problems around the harassment of attendees, and I'm glad to see instances of sexual harassment being taken seriously.  But, I was skeptical of the proposal to rename NIPS.  Nonetheless, after what most everyone would agree was a flawed process, NIPS ended up changing its name branding to what seems to many to be something remarkably awkward.  Time may tell whether this decision was wise.

• My department is hiring for its MCS group, and theoretical computer science, which has grown substantially at UIC in the last few years, is a priority area.  If you're interested in joining us, consider applying (preferably by 1/14)!

UIC's math department in winter. (Photo by me.)

To a happy and productive 2019!

Janus and Higher Education

In its recent Janus v. AFSCME decision, the Supreme Court struck down public sector union security agreements.  This relates to my professional life because UIC is a public university, and our faculty are unionized.  I also have an interest in constitutional law, and I finally have a "jurisdictional hook" to blog about it.  Moreover, I recently realized that while I often hear from pro-union faculty and various union representatives, I rarely see other perspectives, at least at work.  So, as a union non-member, I thought it might be useful to give some brief thoughts about the issues involved.

a photo I took of the Supreme Court building during a recent visit to D.C.

In Janus v. AFSCME, Janus challenged the constitutionality of charging public sector employees "fair share" agency fees.  In about half of the states (those without "right-to-work" laws), when a workforce became unionized, unions were allowed to negotiate security agreements, which gave them the power to collect agency fees from non-members.  The Supreme Court held that these agreements violate non-members' first amendment rights by forcing them to subsidize political speech they disagree with.  Unions were already not permitted to compel non-members to pay for the portion of their activities that are overtly political, but the Supreme Court ruled that in the public sector, union bargaining is inherently political because the unions negotiate with the government, which impacts public policy. Especially illuminating was one particular exchange from the oral argument, between Mr. Franklin, the Solicitor General of Illinois, and Justice Kennedy:

Mr. Franklin: ... Independent of that, we have an interest at the end of the day in being able to work with a stable, responsible, independent counterparty that's well-resourced enough that it can be a partner with us in the process of not only contract negotiation -­ 

Justice Kennedy: It can be a partner with you in advocating for a greater size workforce, against privatization, against merit promotion, against -- for teacher tenure, for higher wages, for massive government, for increasing bonded indebtedness, for increasing taxes? That's -- that's the interest the state has? 

Whether you buy this argument or not, you only have to look at the budget crisis in Illinois to understand the concern.

Turning to my own experience, when I first arrived at UIC, the faculty had just unionized.  And while UIC is not the only public research university with a unionized faculty, I viewed unionization as a worrisome development.  It especially seemed to me that tenure-track faculty at an R1 university should be able to negotiate on their own behalf when the need arises.  My concerns were further reinforced when two years later, a faculty strike almost coincided with our interviewing faculty candidates.  Imagine trying to convince someone to join your department with your colleagues holding "unhappy faculty on strike" signs.  Moreover, I thought it would be detrimental for faculty to have to worry about possible repercussions of teaching during strikes or to face potential political pressure from colleagues to join the union.

a union strike at UIC

As I already mentioned, I never joined the union; but on occasion, various union representatives have tried to get me to join and invariably made the following pitch: "You're going to have to pay the union anyway, so why not sign the membership card and have a say?"  The union wants to keep the majority of the bargaining unit as members in order to avoid facing a credible decertification effort, and thereby wants everyone to join.  And non-members were incentivized to join even if they didn't support the union, so that they could have some say in their contract.  To me, this argument for non-members to join the union seems as objectionable as the impetus will be for members to become "free riders" in the post-Janus world.

So what will happen now that security agreements are struck down? It's hard to predict.  I don't know if it's possible, but I'd like to see a workable middle ground emerge. A compromise, for example, that allows workers to unionize and allows unions to charge, represent, and negotiate on behalf of their members only, while leaving the non-members alone, might be one answer.  I hope there are also other interesting possibilities to consider.  Whatever happens, the status quo is about to change, and I envisage for the better.

A Look Back on 2017

Continuing the tradition of summarizing my year on this blog, here are some things of note from 2017.

• I got tenure this year!  Somehow, even though my job is now about as secure as jobs get these days, I also find myself with a lot more work on my hands than ever before.  I realize it's in some sense self-imposed, but it doesn't really feel like it.  Yet I can't complain; I get to pursue exciting research of my own choosing and work with incredible colleagues and graduate students.

• Steve Hanneke and I co-chaired ALT 2017, which was my first time chairing a conference.  We got lots of great submissions and ended up with what I consider a very strong program.  You can read about my experience here.

• This year, I graduated two more fantastic Ph.D. students: Ádám Lelkes (jointly supervised with György Turán) defended in spring and is now at Google Research and Yi Huang defended in the summer and is now doing a postdoc at the University of Chicago.  In the spirit of the occasion, I've linked to their dissertations rather than their websites.

Left: me, Ádám, and György at Spring commencement.  Right: Yi and me at Fall commencement.

• Li Wang, whose postdoc I hosted, became a tenure-track Assistant Professor at UT Arlington's math department! At UIC, we usually call it "mentoring" instead of "hosting," but Li needed no actual mentoring from me.  I simply had the pleasure of watching her carry out her ambitious research agenda and produce an array of impressive results.

• AlphaZero, a more general and more advanced version of AlphaGo, beat out all other engines in a variety of other two-player games, including Stockfish at chess (and even AlphaGo at Go).  Its chess play feels much more "human" than that of other engines, and I've spent quite a bit of time just watching its games against Stockfish.  I never expected I'd be spending any significant time watching two computers play chess against each other, but here we are.  I'm posting one of these matches, below, for your enjoyment.

A video of AlphaZero putting Stockfish into a beautiful zugzwang.

On a related note, while it's clear deep learning has had and continues to have an impressive impact on the state of the art of AI, I'm curious to what extent these advances in gameplay are the deep learning classifier versus the Monte Carlo Tree Search.  In particular, I wonder how good would AlphaZero be if it combined MCTS with a different classifier?  Anyone who has something interesting to say on this point is welcome to leave a comment below.

• Even though I know it's arbitrary, I can't help but notice when some numbers get a significant digit added in base 10.  This year, my Twitter followers surpassed 1000, and so did my citation count.  Actually these two numbers have been tracking each other rather closely ever since both became non-negligible. A coincidence? 

• I got to see a total solar eclipse over the Grand Tetons and took a pretty nice picture of it.  The next one over the US will be in 2024, which is rather soon as far as these things go -- I highly recommend trying to see it if it's at all possible.  This essay pretty much gets the experience right from my perspective.

totality!

• I've also blogged about this before, but incidents involving students and faculty across multiple universities trying to stifle speech and debate continue a troubling pattern for academia.  These have included a violent attack on Charles Murray and his faculty host at Middlebury, a bizarre tribunal at Wilfred Laurier of a TA named Lindsay Shepard, and The Evergreen State College descending into complete madness over Brett Weinstein's opposition to issues related to an "equity" proposal.  It's also unsurprising to me that these incidents are happening at the most liberal of universities where increasingly effete (or even often sympathetic) administrations are afraid or unwilling to stand up to some of their increasingly emboldened students.  Not all the news on this front is bad: I predict students at Claremont McKenna College will think twice before blockading a speaker again.

• I have no new insights to add, but it seems worth nothing that Bitcoin prices have gone crazy.  I can say that at no point in time have I had any interest in buying or mining Bitcoin, and that hasn't changed. 

the price, in dollars, of 1 Bitcoin versus time

• The "Me Too" movement exposed some very troubling things across many industries.  The machine learning community (and academia in general) is clearly not immune from these problems.  And we also need some institutional changes; the clearest among these is creating systems which can address harassment at gatherings like conferences, which operate outside the normal work/university setting.  I'm glad this is being taken seriously by our community, starting with a rethinking of the code of conduct at NIPS, one of the main machine learning venues.

• Finally, my department is hiring specifically in MCS.  Applications are accepted through 1/22, so it's still not too late to apply.  We have a strong and growing theory group!

Here's to an exciting and productive 2018!

ALT 2017

I’ve just returned from the 28th International Conference on Algorithmic Learning Theory (ALT 2017), which was held in Kyoto, Japan.  The last time ALT was held in Japan was in 2007, exactly 10 years ago.  Back then, I was a second year grad student at my first ALT, and at one of my first conferences altogether.  Now, ten years later, I got to watch my Ph.D. student Mano Vikash present his first conference paper, and I was serving as program co-chair, together with Steve Hanneke.  What a difference 10 years makes!

a photo I took at Yasaka Shrine in Kyoto

Except for handling some last-minute duties concerning session chair assignments and minor issues with the online proceedings, there was little left for me and Steve to do at the actual conference. Once the conference started, the local organizers and general chair took over, and they kept things running smoothly.  But the experience of attending was still different for me.  By the time the conference started, I had read many of the papers and was at least a little familiar with the rest of them.  I also felt a strange sense of responsibility to go to every single talk, and I enjoyed doing this more than I expected.

Being PC chair was a lot of work, but it was quite gratifying.  I appreciate that Steve and I were able to work quite well together.  I’m thankful that so many amazing people agreed to serve on the PC and that our invited speakers readily agreed to come all the way to Japan.  I am thankful that we got many good submissions — more submitted papers than in any year since my first ALT a decade ago.  And I am especially grateful for the quality of the reviews; the PC had to handle more papers than usual, yet the reviews were careful and detailed, catching multiple bugs and providing valuable feedback to authors.  The resulting proceedings are online.

We also had two great invited speakers for ALT.  Sasha Raklin, among other things, gave some interesting results that I was not previously aware of at the intersection of Rademacher complexity and online learning.  Adam Kalai gave great and accessible talk on "fairness" and had a nice way to express various notions of fairness as loss functions. I must admit I’ve been skeptical of this area for a while, but chatting with Adam afterwards has made me less so.  

When blogging about conferences in the past, I discussed some of my favorite papers.  I don’t feel it would be especially appropriate for me to do so in this case, so I’ll just mention the paper for which the E. M. Gold student paper award was given to Tyler Dorhn, an undergraduate student at Yale.  In the paper, Dana Angluin and Tyler Dohrn showed that when equivalence queries are answered randomly, the expected query complexity of exact learning is drastically improved over when equivalence queries are answered adversarially.  In doing so, they introduced a nice notion called the "elimination graph" of a concept space.  It's a concept that I expect to have more applications.   And this is a problem I and others have informally thought about, so I’m glad to see progress in this area.

Finally, I’ll note that ALT has been going through some changes lately.  This year, in addition to more minor tweaks, we switched publication venues from Springer to PMLR (the new name for JMLR’s conference proceedings) in favor of open access, and we got rid of page limits.  More big changes are coming next year: ALT 2018 also will co-locate with AISTATS instead of DS next year, and PC co-chairs Mehryar Mohri and Karthik Sridharan have put out an ambitious call for papers with the goal of becoming the "best conference in algorithmic and theoretical machine learning."  (The co-location with AISTATS also means that the conference is moving from Fall to Spring, and papers are due in a week!)

Computational learning theory has two main conferences: COLT and ALT, with COLT being the larger of the two.  ALT has always had strong authors and PC members, but hadn’t grown in prestige and visibility like COLT.  My former postdoc host John Langford wrote, "ALT = 0.5 COLT." Yet, I’ve always appreciated ALT’s breadth and its resilience to various trends that change the theme of some other conferences almost yearly.  ALT grew this year, and I’m optimistic about its future. And my hope is that ALT can meet its new ambitions while retaining its friendly and open culture.

Doing My Small Part

I've watched with astonishment as multiple universities descended into insanity in the last couple years.  Both my almae matres were affected: Princeton's president catered to protesters who took over his office, and Yale students who organized protests where a college Master was cursed and yelled at were given "leadership" awards at graduation.  I don't doubt that students, including the ones protesting here, may have legitimate grievances, but these latest movements have been bullying in their tactics and misguided in their demands.  You can read the petition I signed onto in Princeton's case.

Woodrow Wilson (photo from history.com), Princeton's most famous alumnus and a former Princeton president, was one of the targets of the protests at Princeton. Thankfully, he avoided having his name scraped off Princeton's School of Public and International Affairs.

But lately, the descent into madness seems to be accelerating. Charles Murray, who has been unfairly maligned as a eugenicist monster, came to Middlebury to deliver a lecture only to be shouted down and physically attacked, with the offending students barely receiving any punishment. Berkeley hasn't been able to host certain conservative speakers without violence breaking out. And very recently, Brett Weinstein, at Evergreen college has been literally hunted because he didn't think he should be asked to leave campus due to his race, and he is receiving no support from the administration. (Listen to this if you want to see how bad things have gotten.) 

In this post, I won't go into the reasons why I think things have gotten so out of control; I have some ideas, but I'm also dumbfounded.  I will say that these latest incidents are so obviously unacceptable that I figured that most university faculty would be on the side of free expression, but it seems I may be sadly mistaken about this.  Brett Weinstein reported that the vast majority of his colleagues who have spoken out on this issue are actually calling on him to be disciplined, and only one other Evergreen professor is willing to defend him publicly.  The protesters and many faculty even blame Weinstein for going on Fox News as the cause of the chaos that resulted on their campus in the aftermath.

So, as a university professor, I want to do my small part and publicly defend Brett Weinstein.  No group should feel entitled to ask any other group to leave campus, especially based on skin color or ethnicity.  Faculty should be able to express their opposition to such requests and to other bad policies without fear of being labeled racists. To me, it is clear that the organizers of some of these protest movements are the actual racists. And Brett Weinstein should be able to go on Fox News or any other forum to express his dismay at the situation.  Needless to say, I also condemn any efforts to silence Charles Murray, Ann Coulter, or the other people facing illiberal forces on college campuses.

It's time to stand up for free and spirited debate and for respectful discourse and common decency. If universities are to remain centers for inquiry and progress, we cannot afford to give these regressive movements another inch.