Try to use notifyDataSetChanged() instead of notifyItemRemoved(), there's a bug in RecyclerView and notifyItemRemoved() does not work in some environments.
Don't give up yet. Our experts can help. Paste your full stack trace to get a solution.
You have a different solution? A short tip here would help you and many other users who saw this issue last week.