Just had my PlugPBX no longer answering http requests, ssh connections or voip calls :(

Before rebooting I connected serially via USB and got this…

Will investigate further whats going on. If anyone else gets this please post in the forums… see this link

I was up for about 5 weeks with no issues before this came up…

[3604963.770000] mvsdio mvsdio: FIFO_EMPTY bit missing
[3604963.770000] EXT2-fs error (device mmcblk0p2): read_block_bitmap: Cannot read block bitmap - block_group = 14, block_bitmap = 458752
[3604963.790000] Remounting filesystem read-only
[3604963.790000] mmcblk0: retrying using single block read
[3604964.810000] mvsdio mvsdio: FIFO_EMPTY bit missing
[3604964.820000] mmcblk0: error -110 sending read/write command, response 0x400d00, card status 0x400d00
[3604964.830000] end_request: I/O error, dev mmcblk0, sector 2708988
[3604965.840000] mvsdio mvsdio: FIFO_EMPTY bit missing
[3604965.850000] mmcblk0: error -110 sending read/write command, response 0x400d00, card status 0x400d00
[3604965.860000] end_request: I/O error, dev mmcblk0, sector 2708989
[3604966.870000] mvsdio mvsdio: FIFO_EMPTY bit missing
[3604966.880000] mmcblk0: error -110 sending read/write command, response 0x400d00, card status 0x400d00
[3604966.890000] end_request: I/O error, dev mmcblk0, sector 2708990
[3604967.900000] mvsdio mvsdio: FIFO_EMPTY bit missing
...and so on...

Rebooting got things back up and running. Nothing apparent in system logs, might have to setup syslog to another box to capture issue or start running a USB serial log from the Plug console to capture this issue next time…

If you want to mitigate the writes to disk (use more write cache etc) make your /etc/rc.local look the following and reboot (or just run the script)

#!/bin/sh -e
#
# rc.local
#
# This script is executed at the end of each multiuser runlevel.
# Make sure that the script will "exit 0" on success or any other
# value on error.
#
# In order to enable or disable this script just change the execution
# bits.
#

# Turn off Swap Disk - Don't need it with this systems footprint
# Setup delayed writes to the SD card

swapoff -a

for i in /sys/block/mmcblk*/queue; do
  echo deadline >$i/scheduler
  echo 5000 >$i/iosched/write_expire
  echo 500 >$i/iosched/read_expire
  echo 1 >$i/iosched/fifo_batch
  echo 4 >$i/iosched/writes_starved
done

exit 0

Still looking into this issue more, follow the forum for progress, or if you have any technical insight into the issue, please contribute! I’ve also got a thread on-going PlugComputer.org’s forums.

Update – I removed partitions 4 and 5 (swap and extended partition it was inside) as it was smaller then its defined size) … When I build the next PlugPBX image I’ll be much more careful when imaging etc… Report any issues (and remember, first attempt, so yes its beta still hehe)