You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-10 - 19:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot3s.osadl.org (updated Sat Jan 10, 2026 12:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
369079399906,58cyclictest0-21swapper/011:28:360
3690793998819,59cyclictest16850irq/134-800000011:53:190
369079399851,79cyclictest3695223-21unin-run08:35:010
369079399849,47cyclictest3783361-21rm12:14:190
369079399811,7cyclictest3725624-21ssh10:10:260
369079399811,12cyclictest3788363-21latency_hist12:25:020
369079399792,72cyclictest3785995-21ssh12:20:010
369079399791,59cyclictest3758931-21ssh11:21:430
369079399762,68cyclictest3772028-21ls11:50:020
369079399762,68cyclictest3772028-21ls11:50:020
369079399761,4cyclictest48-21kcompactd011:37:330
369079399752,5cyclictest3736886-21munin-run10:34:590
3690793997517,53cyclictest16850irq/134-800000009:12:070
369079399751,70cyclictest3763079-21sh11:30:290
3690793997429,40cyclictest3767780-21sh11:40:380
369079399742,5cyclictest3757900-21modprobe11:19:550
369079399741,4cyclictest3743556-21ssh10:49:010
369079399734,7cyclictest364-21snmpd12:10:020
3690793997346,6cyclictest16850irq/134-800000010:40:010
3690793997327,41cyclictest16950irq/224-800000011:06:360
369079399732,5cyclictest3776923-21ssh12:00:120
369079399731,56cyclictest3731549-21ssh10:23:250
3690793997226,29cyclictest3718656-21ssh09:55:400
3690793997214,40cyclictest3744381-21ssh10:50:230
369079399721,2cyclictest0-21swapper/011:04:070
369079399712,9cyclictest3691807-21munin-run07:30:010
369079399712,9cyclictest3691807-21munin-run07:30:010
3690793997115,52cyclictest3709218-21ssh09:35:200
369079399702,5cyclictest3706464-21ssh09:30:000
369079399701,4cyclictest3707502-21ssh09:31:550
369079399693,15cyclictest3703036-21ssh09:22:220
3690793996923,27cyclictest16850irq/134-800000009:45:440
3690793996915,33cyclictest16850irq/134-800000010:44:540
369079399683,45cyclictest16850irq/134-800000010:55:410
3690793996825,26cyclictest3791652-21ssh12:31:530
369079399681,4cyclictest0-21swapper/012:30:010
3690793996721,42cyclictest3701939-21wc09:20:020
369079399671,7cyclictest3753764-21ssh11:10:350
369079399662,19cyclictest3775810-21sh11:58:030
369079399662,19cyclictest3775810-21sh11:58:020
369079399661,19cyclictest3716997-21ssh09:52:140
369079399652,18cyclictest3728973-21ssh10:17:500
3690793996516,44cyclictest16850irq/134-800000012:35:090
369079399651,15cyclictest3711977-21ssh09:41:230
369079399631,4cyclictest0-21swapper/010:26:170
3690793996312,47cyclictest3719286-21kworker/u8:210:10:000
3690793996312,47cyclictest3719286-21kworker/u8:210:09:590
369079399631,10cyclictest3691002-21sshd07:14:560
369079399622,13cyclictest3693212-21latency_hist07:55:020
3690793996212,46cyclictest364-21snmpd08:27:510
369079399621,14cyclictest3693881-21apt-config08:08:410
369079399612,12cyclictest3696211-21sshd08:50:390
369079399611,7cyclictest3692271-21sshd07:35:140
369079399611,6cyclictest3691556-21munin-run07:25:010
369079399611,5cyclictest0-21swapper/010:05:000
369079399601,7cyclictest3694131-21sshd08:10:290
369079399592,50cyclictest1-21systemd08:45:000
369079399591,5cyclictest3695471-21munin-run08:40:010
369079399591,53cyclictest3691279-21sendmail07:19:590
369079399591,4cyclictest3696755-21sshd09:04:570
369079399591,4cyclictest3696479-21modprobe08:59:560
3690793995814,38cyclictest275-21dbus-daemon07:35:010
369079399571,4cyclictest3692554-21sshd07:40:560
369079399571,11cyclictest3694690-21sshd08:24:560
3690793995625,25cyclictest3697012-21cron09:10:010
369079399552,7cyclictest3693628-21munin-run08:05:010
369079399552,7cyclictest3693628-21munin-run08:05:010
3690793995513,38cyclictest3695996-21/usr/sbin/munin08:50:000
369079399551,14cyclictest3693370-21systemd-run08:00:010
369079799548,7cyclictest131rcu_preempt10:25:251
369079399543,46cyclictest3690740-21latency_hist07:10:020
369079399543,46cyclictest3690740-21latency_hist07:10:010
369079799535,9cyclictest23-21ksoftirqd/110:32:551
369079399532,12cyclictest364-21snmpd08:16:550
369079799528,38cyclictest3727552-21unin-run10:15:011
369079799521,8cyclictest3720564-21latency_hist09:59:591
369080299511,27cyclictest361rcuc/311:55:023
3690799995135,12cyclictest1-21systemd10:15:012
369079799512,9cyclictest23-21ksoftirqd/111:57:411
369079799512,9cyclictest23-21ksoftirqd/111:57:411
369079399513,5cyclictest364-21snmpd07:46:290
3690799995030,15cyclictest275-21dbus-daemon08:25:002
369079799503,43cyclictest364-21snmpd07:15:011
3690797995033,13cyclictest3703654-21sshd09:23:561
369079799501,3cyclictest131rcu_preempt12:26:511
3690802994918,21cyclictest361rcuc/310:05:003
369079799494,3cyclictest131rcu_preempt11:35:011
3690797994932,13cyclictest1-21systemd10:20:011
369080299484,3cyclictest131rcu_preempt11:20:013
369080299484,39cyclictest1-21systemd08:35:013
3690802994830,14cyclictest3467602-21systemd-journal08:25:013
3690802994822,9cyclictest37-21ksoftirqd/312:26:513
369079999483,4cyclictest131rcu_preempt10:00:002
3690799994832,12cyclictest3467602-21systemd-journal07:30:012
3690799994832,12cyclictest3467602-21systemd-journal07:30:002
3690799994826,10cyclictest3467602-21systemd-journal12:35:012
369079999482,3cyclictest131rcu_preempt11:10:022
369079799489,4cyclictest131rcu_preempt10:22:111
369079799485,4cyclictest131rcu_preempt10:58:441
3690797994827,14cyclictest0-21swapper/110:40:011
369080299475,3cyclictest131rcu_preempt10:35:023
369080299473,4cyclictest131rcu_preempt11:25:283
369080299472,4cyclictest131rcu_preempt11:37:373
3690802994719,9cyclictest37-21ksoftirqd/308:00:003
369079999474,3cyclictest131rcu_preempt10:32:452
369079799476,5cyclictest131rcu_preempt11:03:061
3690797994732,11cyclictest0-21swapper/112:10:001
3690797994726,15cyclictest3467602-21systemd-journal10:45:011
3690797994711,18cyclictest3696489-21modprobe09:00:011
369080299467,3cyclictest131rcu_preempt11:47:453
369080299467,3cyclictest131rcu_preempt11:47:453
3690802994634,9cyclictest3749672-21sshd11:01:563
3690802994626,14cyclictest275-21dbus-daemon11:00:013
3690802994618,15cyclictest3739286-21kworker/3:111:09:083
3690799994630,12cyclictest30-21ksoftirqd/211:45:022
3690797994633,9cyclictest275-21dbus-daemon10:10:011
3690797994633,9cyclictest275-21dbus-daemon10:10:011
369079799462,4cyclictest131rcu_preempt11:47:021
369079799462,4cyclictest131rcu_preempt11:47:021
369080299453,3cyclictest131rcu_preempt09:27:123
3690802994532,10cyclictest3467602-21systemd-journal09:55:003
3690802994527,13cyclictest1-21systemd08:15:013
369080299452,4cyclictest131rcu_preempt09:20:013
369080299452,3cyclictest131rcu_preempt10:30:023
369080299451,4cyclictest131rcu_preempt10:08:473
369080299451,4cyclictest131rcu_preempt10:08:463
369080299451,4cyclictest131rcu_preempt09:40:003
369080299451,3cyclictest131rcu_preempt07:40:013
369079999458,27cyclictest3694693-21kworker/2:008:35:022
369079999454,3cyclictest131rcu_preempt10:41:542
3690799994532,10cyclictest3694044-21sed08:10:022
369079999452,40cyclictest3786121-21ssh12:20:022
369079999452,3cyclictest131rcu_preempt10:05:072
369079999452,3cyclictest131rcu_preempt10:05:072
369079999451,3cyclictest131rcu_preempt09:40:012
3690797994525,14cyclictest3467602-21systemd-journal08:50:001
3690797994519,17cyclictest364-21snmpd11:55:011
369080299445,3cyclictest131rcu_preempt12:25:013
3690802994428,12cyclictest275-21dbus-daemon08:50:013
369080299442,4cyclictest131rcu_preempt12:06:153
369080299442,3cyclictest131rcu_preempt12:10:213
369080299442,3cyclictest131rcu_preempt10:39:223
369080299441,4cyclictest131rcu_preempt09:35:023
369080299441,3cyclictest131rcu_preempt12:02:373
369080299441,3cyclictest131rcu_preempt07:40:153
369079999444,5cyclictest131rcu_preempt10:24:592
3690799994431,9cyclictest1-21systemd12:10:012
3690799994426,13cyclictest3760506-21sed11:25:022
3690799994425,14cyclictest275-21dbus-daemon08:15:002
369079999441,3cyclictest131rcu_preempt10:28:522
369079799447,7cyclictest131rcu_preempt11:30:011
369079799442,4cyclictest131rcu_preempt12:38:241
3690797994424,16cyclictest275-21dbus-daemon10:50:011
3690797994423,16cyclictest275-21dbus-daemon11:45:001
369079799441,4cyclictest131rcu_preempt09:43:301
369080299433,3cyclictest131rcu_preempt12:37:583
369080299433,3cyclictest131rcu_preempt11:12:063
3690802994328,11cyclictest37-21ksoftirqd/311:30:343
3690802994326,12cyclictest37-21ksoftirqd/307:35:003
369080299432,3cyclictest131rcu_preempt09:56:253
369080299431,4cyclictest131rcu_preempt12:35:023
369080299431,4cyclictest131rcu_preempt11:57:033
369080299431,4cyclictest131rcu_preempt11:57:023
369080299431,4cyclictest131rcu_preempt09:14:363
369080299431,4cyclictest131rcu_preempt08:45:003
369080299431,3cyclictest131rcu_preempt10:17:063
369080299431,3cyclictest131rcu_preempt09:25:023
369079999435,4cyclictest131rcu_preempt11:00:002
369079999434,4cyclictest131rcu_preempt12:29:562
3690799994331,9cyclictest30-21ksoftirqd/212:40:012
369079999431,3cyclictest131rcu_preempt09:15:472
3690797994326,10cyclictest1-21systemd09:30:011
3690797994325,13cyclictest3467602-21systemd-journal09:05:001
3690797994324,13cyclictest275-21dbus-daemon12:25:011
3690797994324,12cyclictest3467602-21systemd-journal11:20:001
369079799432,3cyclictest131rcu_preempt12:10:121
3690802994227,11cyclictest37-21ksoftirqd/311:43:293
369080299422,4cyclictest131rcu_preempt10:51:363
369080299422,3cyclictest131rcu_preempt11:21:353
369080299422,3cyclictest131rcu_preempt10:15:013
369080299422,3cyclictest131rcu_preempt08:05:023
369080299422,3cyclictest131rcu_preempt08:05:023
369080299421,3cyclictest131rcu_preempt12:18:463
369080299421,3cyclictest131rcu_preempt10:45:103
369080299421,3cyclictest131rcu_preempt09:45:563
3690802994212,9cyclictest37-21ksoftirqd/310:21:003
369079999422,4cyclictest131rcu_preempt11:58:312
369079999422,4cyclictest131rcu_preempt11:58:312
369079999421,4cyclictest131rcu_preempt10:47:062
369079999421,3cyclictest131rcu_preempt11:30:012
369079999421,3cyclictest131rcu_preempt11:05:002
369079999421,3cyclictest131rcu_preempt09:55:002
369079799429,5cyclictest131rcu_preempt12:32:451
369079799425,3cyclictest131rcu_preempt09:10:401
369079799423,7cyclictest23-21ksoftirqd/108:35:011
369079799423,3cyclictest131rcu_preempt11:40:011
369079799423,3cyclictest131rcu_preempt11:09:081
369079799423,3cyclictest131rcu_preempt09:30:401
3690797994229,9cyclictest3711174-21cron09:40:011
3690797994227,11cyclictest275-21dbus-daemon07:30:021
3690797994227,11cyclictest275-21dbus-daemon07:30:011
3690797994226,11cyclictest3467602-21systemd-journal07:45:561
3690797994225,12cyclictest275-21dbus-daemon08:05:011
3690797994225,12cyclictest275-21dbus-daemon08:05:001
369080299415,3cyclictest131rcu_preempt07:30:013
369080299415,3cyclictest131rcu_preempt07:30:013
369080299413,4cyclictest131rcu_preempt08:09:593
369080299412,3cyclictest131rcu_preempt10:40:023
369080299411,4cyclictest131rcu_preempt09:40:553
369079999414,3cyclictest131rcu_preempt12:05:022
369079999413,3cyclictest131rcu_preempt09:41:542
3690799994128,10cyclictest3696743-21sshd09:00:562
3690799994126,11cyclictest30-21ksoftirqd/210:38:122
3690799994125,12cyclictest1-21systemd11:35:002
369079999412,3cyclictest131rcu_preempt11:37:512
369079799415,4cyclictest131rcu_preempt11:10:451
3690797994123,14cyclictest3693348-21systemctl08:00:001
369079799411,3cyclictest131rcu_preempt09:52:141
369080299404,4cyclictest131rcu_preempt08:30:013
3690802994030,6cyclictest3694429-21sh08:20:003
3690802994019,16cyclictest3467602-21systemd-journal09:10:013
369080299401,3cyclictest131rcu_preempt09:03:573
369079999404,3cyclictest131rcu_preempt07:10:032
369079999404,3cyclictest131rcu_preempt07:10:032
369079999403,3cyclictest131rcu_preempt09:29:052
369079999403,3cyclictest131rcu_preempt09:21:022
3690799994029,8cyclictest3770237-21sshd11:46:042
3690799994029,8cyclictest3770237-21sshd11:46:042
3690799994028,9cyclictest3715938-21sed09:50:022
3690799994028,9cyclictest3692613-21sed07:45:022
3690799994027,10cyclictest30-21ksoftirqd/209:10:012
3690799994026,10cyclictest1-21systemd11:55:002
369079999402,3cyclictest131rcu_preempt07:20:012
369079999401,4cyclictest131rcu_preempt11:19:572
369079999401,4cyclictest131rcu_preempt09:10:152
3690799994010,6cyclictest131rcu_preempt10:54:302
3690797994023,13cyclictest1-21systemd11:25:011
3690797994018,5cyclictest23-21ksoftirqd/109:47:381
3690802993925,11cyclictest3691535-21sshd07:23:563
3690799993927,10cyclictest30-21ksoftirqd/212:21:492
3690799993927,10cyclictest30-21ksoftirqd/208:00:002
3690799993926,10cyclictest30-21ksoftirqd/209:33:142
369079999392,3cyclictest131rcu_preempt11:11:302
369079999392,3cyclictest131rcu_preempt07:55:012
369079799393,8cyclictest23-21ksoftirqd/109:18:361
3690797993926,10cyclictest23-21ksoftirqd/112:19:501
3690797993910,6cyclictest131rcu_preempt10:51:551
369080299383,4cyclictest131rcu_preempt07:55:003
3690802993827,7cyclictest3695502-21systemd-run08:40:013
3690802993824,11cyclictest37-21ksoftirqd/307:50:003
369080299381,4cyclictest131rcu_preempt07:19:593
3690802993810,12cyclictest37-21ksoftirqd/309:00:013
369079999385,3cyclictest131rcu_preempt10:15:172
3690799993829,5cyclictest3783655-21cron12:15:012
3690799993826,8cyclictest1-21systemd09:00:002
3690799993825,9cyclictest1-21systemd07:15:012
369079999382,4cyclictest131rcu_preempt07:50:012
369079999382,3cyclictest131rcu_preempt08:05:012
369079999382,3cyclictest131rcu_preempt08:05:002
369079799383,5cyclictest131rcu_preempt10:01:301
369079799383,4cyclictest131rcu_preempt12:00:301
3690797993825,9cyclictest3692311-21cat07:40:011
369080299372,4cyclictest131rcu_preempt08:55:023
3690802993724,11cyclictest37-21ksoftirqd/307:10:023
3690802993724,11cyclictest37-21ksoftirqd/307:10:013
369079999375,6cyclictest131rcu_preempt08:35:012
369079999374,3cyclictest131rcu_preempt10:01:002
369079999373,3cyclictest131rcu_preempt07:32:572
3690799993728,6cyclictest309-21in:imuxsock07:35:012
3690799993723,10cyclictest309-21in:imuxsock07:20:032
369079799375,23cyclictest3467602-21systemd-journal08:20:011
3690797993727,7cyclictest3691257-21sshd07:18:571
3690799993622,10cyclictest3467602-21systemd-journal08:45:392
369079799366,4cyclictest131rcu_preempt07:35:001
3690799993520,10cyclictest309-21in:imuxsock08:17:012
369079799357,22cyclictest3697035-21munin-plugin-st09:10:011
369079799356,19cyclictest3694960-21munin-plugin-st08:30:001
3690797993524,8cyclictest23-21ksoftirqd/107:55:001
3690797993522,9cyclictest309-21in:imuxsock08:35:341
3690797993522,10cyclictest23-21ksoftirqd/108:08:401
3690797993520,9cyclictest0-21swapper/107:25:011
369080299343,3cyclictest131rcu_preempt07:11:563
369079999341,3cyclictest131rcu_preempt08:25:562
3690797993412,17cyclictest275-21dbus-daemon08:45:011
3690799993320,8cyclictest309-21in:imuxsock08:55:012
369079999331,3cyclictest131rcu_preempt08:45:012
369079799335,3cyclictest131rcu_preempt07:45:001
3690797993321,9cyclictest3694353-21sed08:15:021
369079799325,3cyclictest131rcu_preempt07:10:021
369079799325,3cyclictest131rcu_preempt07:10:011
3690797993221,8cyclictest23-21ksoftirqd/108:25:001
3690797993013,13cyclictest275-21dbus-daemon08:55:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional