You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-16 - 20:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7s.osadl.org (updated Mon Jun 16, 2025 12:41:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
493225996052,5cyclictest598803-21munin-run11:00:011
493227995143,5cyclictest610208-21munin-run11:20:012
493227994537,5cyclictest506718-21systemd-run07:55:012
493227994537,5cyclictest503711-21munin-run07:45:012
493227994536,6cyclictest3894606-21cups-browsed12:27:492
493227994437,4cyclictest521707-21cut08:45:012
493227994335,5cyclictest493235-21systemd-run07:10:042
493227994334,6cyclictest3894606-21cups-browsed12:00:012
493224994334,6cyclictest637651-21unin-run12:00:020
493224994331,10cyclictest586181-21systemd-run10:40:020
493225994235,4cyclictest623151-21cron11:40:011
493225994233,6cyclictest422-21dbus-daemon11:45:011
493224994235,5cyclictest642647-21tail12:07:370
493224994234,6cyclictest957-21mta-sts-daemon11:47:430
493225994133,5cyclictest573716-21munin-run10:20:011
493224994133,6cyclictest633962-21sh11:55:020
493227994034,3cyclictest0-21swapper/210:22:532
493227994033,4cyclictest641283-21cut12:05:012
493225994032,5cyclictest560755-21latency_hist10:00:011
493224994033,5cyclictest654103-21ntpq12:22:510
493224994033,5cyclictest654103-21ntpq12:22:510
493227993930,6cyclictest526220-21systemd-run09:00:012
493225993931,5cyclictest524714-21systemd-run08:55:011
493227993830,5cyclictest563966-21systemd-run10:05:022
493227993829,6cyclictest422-21dbus-daemon12:33:442
493227993827,8cyclictest422-21dbus-daemon09:30:022
493225993829,5cyclictest422-21dbus-daemon12:22:511
493225993829,5cyclictest422-21dbus-daemon12:22:511
493225993828,7cyclictest529200-21diskmemload09:52:491
493224993832,4cyclictest583276-21latency_hist10:35:030
493224993831,4cyclictest579832-21systemd-run10:30:010
493227993730,4cyclictest497718-21ls07:25:002
493227993730,4cyclictest0-21swapper/211:42:532
493227993729,6cyclictest548275-21sh09:40:022
493227993729,5cyclictest514198-21munin-plugin-st08:20:012
493227993728,5cyclictest584290-21aten2.4-expect10:37:412
493225993727,6cyclictest959-21mta-sts-daemon10:45:181
493227993629,4cyclictest957-21mta-sts-daemon11:04:402
493227993629,3cyclictest0-21swapper/210:32:492
493227993628,5cyclictest643872-21unixbench_multi12:08:032
493227993628,5cyclictest604678-21grep11:10:032
493225993631,2cyclictest0-21swapper/111:35:011
493225993626,7cyclictest3894606-21cups-browsed12:30:571
493224993629,5cyclictest1-21systemd08:10:010
493224993627,4cyclictest698-21cron09:25:010
493227993529,3cyclictest0-21swapper/211:00:012
493227993527,5cyclictest579128-21unixbench_multi10:28:012
493227993526,6cyclictest421-21avahi-daemon09:02:412
493227993524,8cyclictest1-21systemd09:45:022
493225993528,4cyclictest506691-21cron07:55:011
493225993527,5cyclictest562566-21needreboot10:02:461
493227993427,4cyclictest956-21mta-sts-daemon09:12:042
493227993425,5cyclictest3894606-21cups-browsed10:42:392
493227993424,7cyclictest3894606-21cups-browsed11:39:382
493225993426,5cyclictest547410-21unixbench_multi09:37:591
493225993426,5cyclictest541036-21ssh09:27:591
493225993426,4cyclictest508189-21sendmail08:00:011
49322599341,22cyclictest578623-21ssh10:27:521
493224993428,4cyclictest573733-21awk10:20:010
493224993428,4cyclictest546766-21needreboot09:37:440
493224993427,4cyclictest956-21mta-sts-daemon12:35:580
493227993327,3cyclictest0-21swapper/210:07:582
493227993327,3cyclictest0-21swapper/210:07:582
493227993326,3cyclictest0-21swapper/210:52:482
493227993325,5cyclictest502198-21munin-run07:40:002
493227993324,6cyclictest474-21in:imuxsock09:35:012
493227993324,5cyclictest1-21systemd08:37:562
493227993323,7cyclictest553156-21ntp_kernel_pll_09:47:462
493227993322,8cyclictest528554-21ntp_kernel_err09:07:482
493225993327,4cyclictest955-21mta-sts-daemon10:32:211
493225993325,5cyclictest511217-21systemd-run08:10:011
493225993325,5cyclictest422-21dbus-daemon07:37:441
493225993324,6cyclictest957-21mta-sts-daemon12:05:061
493225993324,6cyclictest453-21systemd-logind12:30:021
493225993323,7cyclictest612595-21timerwakeupswit11:23:021
493225993323,7cyclictest612595-21timerwakeupswit11:23:021
493225993322,7cyclictest629234-21timerwakeupswit11:48:011
49322599332,19cyclictest665809-21ssh12:37:471
493224993328,3cyclictest518637-21unixbench_singl08:32:580
493224993327,3cyclictest0-21swapper/012:20:020
493224993327,3cyclictest0-21swapper/011:43:400
493224993326,5cyclictest684-21munin-node07:43:000
493224993326,5cyclictest422-21dbus-daemon12:15:020
493227993227,2cyclictest0-21swapper/210:50:012
493227993226,3cyclictest0-21swapper/211:52:522
493227993226,3cyclictest0-21swapper/210:13:002
493227993224,5cyclictest628715-21ssh11:47:482
493227993224,5cyclictest612662-21unixbench_multi11:23:032
493227993224,5cyclictest612662-21unixbench_multi11:23:032
493227993218,10cyclictest422-21dbus-daemon11:32:512
493225993226,3cyclictest0-21swapper/111:20:011
493225993224,6cyclictest0-21swapper/112:02:381
493225993224,5cyclictest616655-21latency_hist11:30:021
493225993224,5cyclictest568680-21ssh10:12:431
493225993223,6cyclictest474-21in:imuxsock10:40:011
493225993222,8cyclictest635979-21sh11:57:481
493224993226,4cyclictest514098-21grep08:17:550
493224993225,4cyclictest562043-21aten2.4-expect10:02:380
493224993223,3cyclictest557518-21cron09:55:010
493227993125,3cyclictest0-21swapper/211:27:542
493227993125,3cyclictest0-21swapper/208:27:442
493227993121,6cyclictest3894606-21cups-browsed09:21:022
493227993120,8cyclictest514964-21missed_timers08:22:582
493225993124,4cyclictest549694-21latency09:42:441
493225993124,4cyclictest531043-21latency09:12:441
493225993123,5cyclictest543983-21mailstats09:33:011
493225993123,5cyclictest526196-21readlink09:00:011
493225993123,5cyclictest421-21avahi-daemon09:08:011
493225993123,5cyclictest3894606-21cups-browsed12:18:371
493225993123,5cyclictest3894606-21cups-browsed11:07:211
493225993123,5cyclictest3894606-21cups-browsed10:21:581
493225993123,5cyclictest3894606-21cups-browsed08:00:371
493225993123,5cyclictest3894606-21cups-browsed07:12:591
493225993122,6cyclictest421-21avahi-daemon10:54:021
493225993121,7cyclictest601054-21timerandwakeup11:02:591
49322499317,16cyclictest12450irq/32-eth011:12:550
493224993126,3cyclictest598803-21munin-run11:00:010
493224993125,4cyclictest591698-21head10:48:010
493224993125,4cyclictest549309-21aten_r2power_fr09:42:350
493224993125,3cyclictest0-21swapper/010:23:010
493224993124,5cyclictest421-21avahi-daemon09:17:560
493224993124,5cyclictest1-21systemd11:20:010
493224993123,6cyclictest588026-21sh10:42:530
493224993123,5cyclictest599070-21kworker/u8:14+xprtiod11:40:010
493224993123,5cyclictest3894606-21cups-browsed12:30:250
493227993024,3cyclictest0-21swapper/211:12:532
493227993024,3cyclictest0-21swapper/210:17:422
493227993024,3cyclictest0-21swapper/209:17:382
493227993023,4cyclictest508866-21kernelversion08:02:582
493227993022,5cyclictest504561-21ntp_kernel_err07:47:472
493227993021,6cyclictest421-21avahi-daemon12:12:502
493225993023,4cyclictest955-21mta-sts-daemon11:12:061
493225993023,4cyclictest521706-21munin-plugin-st08:45:011
493225993022,5cyclictest514155-21unixbench_singl08:17:561
493225993022,5cyclictest3894606-21cups-browsed07:41:481
493224993024,4cyclictest640336-21unixbench_singl12:02:590
493224993022,5cyclictest3894606-21cups-browsed09:32:160
493224993021,6cyclictest0-21swapper/007:20:010
493224993019,9cyclictest266-21systemd-journal10:55:030
493227992923,3cyclictest0-21swapper/212:37:432
493227992923,3cyclictest0-21swapper/209:52:542
493227992923,3cyclictest0-21swapper/208:13:072
493227992923,3cyclictest0-21swapper/208:00:012
493227992922,4cyclictest957-21mta-sts-daemon12:15:182
493227992922,3cyclictest0-21swapper/212:22:402
493227992922,3cyclictest0-21swapper/212:22:402
493227992920,6cyclictest523211-21systemd-run08:50:012
493225992923,3cyclictest0-21swapper/109:47:451
493225992923,3cyclictest0-21swapper/109:20:011
493225992922,4cyclictest515701-21cron08:25:011
493225992921,5cyclictest3894606-21cups-browsed07:47:411
493225992921,5cyclictest266-21systemd-journal07:30:011
493225992920,6cyclictest517110-21unixbench_multi08:27:561
49322599291,23cyclictest565801-21ssh10:07:511
49322599291,23cyclictest565801-21ssh10:07:511
493224992924,2cyclictest0-21swapper/009:00:010
493224992923,4cyclictest617970-21ssh11:32:410
493224992923,4cyclictest529015-21timerwakeupswit09:08:000
493224992921,6cyclictest509244-21proc_pri08:03:080
493224992921,4cyclictest604722-21latency_hist11:10:030
493224992911,3cyclictest171rcu_preempt09:27:380
493227992820,3cyclictest0-21swapper/209:57:462
493225992822,3cyclictest0-21swapper/112:15:011
493225992821,4cyclictest422-21dbus-daemon07:15:121
493225992821,4cyclictest0-21swapper/108:12:531
493224992822,4cyclictest266-21systemd-journal10:10:000
493224992822,4cyclictest266-21systemd-journal10:10:000
493224992822,3cyclictest956-21mta-sts-daemon09:45:550
493224992822,3cyclictest0-21swapper/009:12:370
493224992821,5cyclictest568925-21sh10:12:480
493224992814,12cyclictest511856-21kernelversion08:12:420
493227992718,5cyclictest518686-21cron08:35:012
493225992719,5cyclictest3894606-21cups-browsed07:31:401
493225992719,5cyclictest3894606-21cups-browsed07:31:401
49322499278,13cyclictest12550irq/33-eth012:27:460
493224992722,3cyclictest600471-21missed_timers11:02:440
493224992722,3cyclictest523147-21unixbench_singl08:48:020
493224992721,4cyclictest524687-21munin-plugin-st08:55:010
493224992721,4cyclictest500699-21latency_hist07:35:020
493224992721,4cyclictest500699-21latency_hist07:35:020
493227992621,2cyclictest0-21swapper/207:20:012
493227992619,4cyclictest524228-21proc_pri08:52:552
493227992619,4cyclictest422-21dbus-daemon07:15:012
493227992618,4cyclictest959-21mta-sts-daemon08:07:572
493225992621,2cyclictest0-21swapper/111:52:451
493225992621,2cyclictest0-21swapper/109:22:421
493225992617,6cyclictest588185-21sendmail_mailst10:42:581
493224992620,4cyclictest955-21mta-sts-daemon07:27:490
493224992620,3cyclictest0-21swapper/007:15:020
493224992619,5cyclictest0-21swapper/010:00:030
493224992618,5cyclictest422-21dbus-daemon11:27:290
493227992510,11cyclictest422-21dbus-daemon07:27:432
493225992519,3cyclictest0-21swapper/107:22:521
493225992517,5cyclictest527697-21cron09:05:011
49322499255,12cyclictest684-21munin-node07:10:030
493224992520,3cyclictest519443-21missed_timers08:37:440
493224992520,2cyclictest0-21swapper/007:40:020
493224992519,4cyclictest508195-21basename08:00:010
493224992518,6cyclictest493223-21cyclictest08:22:420
493224992518,4cyclictest955-21mta-sts-daemon11:22:550
493224992518,4cyclictest955-21mta-sts-daemon11:22:550
49322499251,16cyclictest0-21swapper/009:02:520
493227992418,3cyclictest0-21swapper/207:35:012
493227992418,3cyclictest0-21swapper/207:35:012
493225992414,7cyclictest520185-21sh08:40:011
493225992413,8cyclictest493331-21sed07:10:061
49322499243,11cyclictest437-21mta-sts-daemon08:42:470
493224992418,4cyclictest3894606-21cups-browsed07:20:120
493225992317,3cyclictest0-21swapper/108:47:521
493225992317,3cyclictest0-21swapper/108:35:011
493224992217,3cyclictest657-21snmpd08:27:550
493224992217,2cyclictest0-21swapper/007:55:010
49322499211,17cyclictest504685-21ntpq07:47:530
49322999131,7cyclictest0-21swapper/312:17:573
49322999122,6cyclictest0-21swapper/310:07:493
49322999122,6cyclictest0-21swapper/310:07:493
49322999122,6cyclictest0-21swapper/309:57:483
49322999122,6cyclictest0-21swapper/309:27:493
49322999122,5cyclictest0-21swapper/312:32:483
49322999121,7cyclictest0-21swapper/311:37:463
49322999121,7cyclictest0-21swapper/311:32:513
49322999121,7cyclictest0-21swapper/309:22:493
49322999113,5cyclictest0-21swapper/311:20:013
49322999112,6cyclictest0-21swapper/311:08:393
49322999112,5cyclictest0-21swapper/311:47:523
49322999112,5cyclictest0-21swapper/310:22:503
49322999112,5cyclictest0-21swapper/310:12:363
49322999112,5cyclictest0-21swapper/309:37:463
49322999112,5cyclictest0-21swapper/309:32:493
49322999112,5cyclictest0-21swapper/309:17:423
49322999111,6cyclictest0-21swapper/312:27:463
49322999111,6cyclictest0-21swapper/312:22:343
49322999111,6cyclictest0-21swapper/312:22:343
49322999111,6cyclictest0-21swapper/312:07:373
49322999111,6cyclictest0-21swapper/311:57:483
49322999111,6cyclictest0-21swapper/311:42:563
49322999111,6cyclictest0-21swapper/310:32:493
49322999111,6cyclictest0-21swapper/309:43:013
49322999111,6cyclictest0-21swapper/308:47:483
49322999110,8cyclictest0-21swapper/308:05:033
49322999102,5cyclictest0-21swapper/312:02:493
49322999102,5cyclictest0-21swapper/310:47:563
49322999102,5cyclictest0-21swapper/310:37:503
49322999102,5cyclictest0-21swapper/310:18:003
49322999102,5cyclictest0-21swapper/310:02:553
49322999102,5cyclictest0-21swapper/309:52:483
49322999102,5cyclictest0-21swapper/309:47:493
49322999102,5cyclictest0-21swapper/309:10:013
49322999101,6cyclictest0-21swapper/312:37:523
49322999101,6cyclictest0-21swapper/312:12:573
49322999101,6cyclictest0-21swapper/311:27:523
49322999101,6cyclictest0-21swapper/311:22:493
49322999101,6cyclictest0-21swapper/311:22:493
49322999101,6cyclictest0-21swapper/311:02:543
49322999101,6cyclictest0-21swapper/310:52:533
49322999101,6cyclictest0-21swapper/310:42:473
49322999101,6cyclictest0-21swapper/310:27:513
49322999101,6cyclictest0-21swapper/309:12:513
49322999101,5cyclictest0-21swapper/311:51:023
49322999101,5cyclictest0-21swapper/310:57:363
49322999101,5cyclictest0-21swapper/308:37:513
49322999101,5cyclictest0-21swapper/308:27:443
49322999101,5cyclictest0-21swapper/307:37:443
49322999101,5cyclictest0-21swapper/307:17:453
4932299992,5cyclictest0-21swapper/307:42:473
4932299992,4cyclictest0-21swapper/308:32:483
4932299992,4cyclictest0-21swapper/308:12:463
4932299991,5cyclictest0-21swapper/311:12:063
4932299991,5cyclictest0-21swapper/309:02:483
4932299991,5cyclictest0-21swapper/308:57:483
4932299991,5cyclictest0-21swapper/308:42:453
4932299991,5cyclictest0-21swapper/308:22:583
4932299991,5cyclictest0-21swapper/308:17:433
4932299991,5cyclictest0-21swapper/307:57:443
4932299991,5cyclictest0-21swapper/307:52:483
4932299991,5cyclictest0-21swapper/307:47:483
4932299991,5cyclictest0-21swapper/307:27:433
4932299991,5cyclictest0-21swapper/307:20:073
4932299991,5cyclictest0-21swapper/307:12:503
4932299981,5cyclictest0-21swapper/308:07:493
4932299981,4cyclictest0-21swapper/307:32:353
4932299981,4cyclictest0-21swapper/307:32:353
4932299981,4cyclictest0-21swapper/307:10:063
4932299980,5cyclictest0-21swapper/308:52:423
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional