You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-03 - 04:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri Jul 03, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24573991918,1cyclictest65850irq/126-lan23:30:150
24573991818,0cyclictest65850irq/126-lan20:05:180
24573991818,0cyclictest65850irq/126-lan00:28:490
24573991817,1cyclictest65850irq/126-lan23:25:170
24573991817,1cyclictest65850irq/126-lan20:45:160
24573991817,1cyclictest65850irq/126-lan20:45:160
24573991817,1cyclictest65850irq/126-lan19:20:170
24573991817,1cyclictest65850irq/126-lan19:15:130
24578991717,0cyclictest743-21snmpd22:32:091
24573991717,0cyclictest65850irq/126-lan23:35:180
24573991717,0cyclictest65850irq/126-lan22:35:100
24573991716,1cyclictest65850irq/126-lan23:15:180
24573991716,1cyclictest65850irq/126-lan22:45:150
24573991716,1cyclictest65850irq/126-lan22:00:210
24573991716,1cyclictest65850irq/126-lan21:16:170
24573991716,1cyclictest65850irq/126-lan19:25:170
24573991716,1cyclictest65850irq/126-lan00:12:460
24578991616,0cyclictest743-21snmpd23:13:381
24578991616,0cyclictest743-21snmpd22:43:041
24578991616,0cyclictest743-21snmpd22:09:531
24578991616,0cyclictest743-21snmpd21:58:551
24578991616,0cyclictest743-21snmpd20:12:511
24578991616,0cyclictest743-21snmpd19:32:271
24573991616,0cyclictest65850irq/126-lan23:55:000
24573991616,0cyclictest65850irq/126-lan20:50:210
24573991615,1cyclictest65850irq/126-lan22:15:130
24573991615,1cyclictest65850irq/126-lan21:30:150
24573991615,1cyclictest65850irq/126-lan20:55:190
24573991615,1cyclictest65850irq/126-lan20:20:140
24573991615,1cyclictest65850irq/126-lan19:10:150
24573991615,1cyclictest65850irq/126-lan00:20:220
24578991515,0cyclictest743-21snmpd23:55:211
24578991515,0cyclictest743-21snmpd23:16:101
24578991515,0cyclictest743-21snmpd21:15:191
24578991515,0cyclictest743-21snmpd21:09:231
24578991515,0cyclictest743-21snmpd20:43:461
24578991515,0cyclictest743-21snmpd20:43:451
24578991515,0cyclictest743-21snmpd20:18:531
24578991515,0cyclictest743-21snmpd19:11:301
24578991515,0cyclictest743-21snmpd00:28:391
24578991515,0cyclictest1206-21cat20:50:141
24573991515,0cyclictest65850irq/126-lan21:55:200
24573991515,0cyclictest65850irq/126-lan21:45:200
24573991515,0cyclictest65850irq/126-lan21:40:130
24573991515,0cyclictest65850irq/126-lan21:35:190
24573991515,0cyclictest65850irq/126-lan20:16:440
24573991515,0cyclictest65850irq/126-lan19:50:190
24573991515,0cyclictest65850irq/126-lan00:02:510
24573991514,1cyclictest65850irq/126-lan23:40:140
24573991514,1cyclictest65850irq/126-lan23:04:490
24573991514,1cyclictest65850irq/126-lan22:40:210
24573991514,1cyclictest65850irq/126-lan21:10:150
24573991514,1cyclictest65850irq/126-lan21:00:130
24573991514,1cyclictest65850irq/126-lan19:35:150
24578991414,0cyclictest8458-21cat22:25:141
24578991414,0cyclictest743-21snmpd22:56:171
24578991414,0cyclictest743-21snmpd22:47:061
24578991414,0cyclictest743-21snmpd21:22:591
24578991414,0cyclictest743-21snmpd20:30:211
24578991414,0cyclictest743-21snmpd19:19:541
24578991414,0cyclictest743-21snmpd00:19:551
24578991414,0cyclictest743-21snmpd00:01:131
24578991414,0cyclictest29258-21cat19:20:141
24578991414,0cyclictest24617-21cat23:05:131
24578991414,0cyclictest23386-21cat00:20:141
24578991414,0cyclictest17791-21cat21:30:151
24573991414,0cyclictest65850irq/126-lan22:55:220
24573991414,0cyclictest65850irq/126-lan22:25:110
24573991414,0cyclictest65850irq/126-lan22:07:480
24573991414,0cyclictest65850irq/126-lan21:20:140
24573991414,0cyclictest65850irq/126-lan20:30:150
24573991414,0cyclictest65850irq/126-lan20:25:110
24573991414,0cyclictest65850irq/126-lan20:10:170
24573991414,0cyclictest65850irq/126-lan20:00:160
24573991414,0cyclictest65850irq/126-lan00:30:180
24573991413,1cyclictest65850irq/126-lan23:50:120
24573991413,1cyclictest65850irq/126-lan22:50:120
24573991413,1cyclictest65850irq/126-lan21:05:180
24578991313,0cyclictest743-21snmpd22:36:511
24573991313,0cyclictest65850irq/126-lan21:25:190
24573991313,0cyclictest65850irq/126-lan20:35:120
24573991313,0cyclictest65850irq/126-lan19:55:140
24573991313,0cyclictest65850irq/126-lan19:47:510
24573991313,0cyclictest65850irq/126-lan00:06:500
24573991312,1cyclictest65850irq/126-lan23:05:120
24573991312,1cyclictest65850irq/126-lan22:20:150
24573991312,1cyclictest65850irq/126-lan22:10:190
24573991312,1cyclictest65850irq/126-lan20:40:010
24573991312,1cyclictest65850irq/126-lan20:40:000
24573991212,0cyclictest65850irq/126-lan23:46:510
24573991212,0cyclictest65850irq/126-lan00:35:180
24573991212,0cyclictest65850irq/126-lan00:15:500
24573991211,1cyclictest65850irq/126-lan22:30:140
24573991211,1cyclictest65850irq/126-lan21:50:200
24573991111,0cyclictest65850irq/126-lan23:20:130
24573991110,1cyclictest65850irq/126-lan19:30:200
2457399109,1cyclictest65850irq/126-lan19:40:190
245889998,1cyclictest743-21snmpd21:36:393
245889998,1cyclictest743-21snmpd19:49:013
245889998,1cyclictest741-21lldpd19:13:043
245829999,0cyclictest743-21snmpd19:11:572
245829998,1cyclictest743-21snmpd20:32:272
245829998,1cyclictest743-21snmpd19:52:552
245829998,1cyclictest741-21lldpd20:05:192
245789998,1cyclictest743-21snmpd23:32:201
245789998,1cyclictest741-21lldpd00:06:021
245739998,1cyclictest65850irq/126-lan23:12:530
245889988,0cyclictest743-21snmpd22:30:243
245889988,0cyclictest741-21lldpd19:51:063
245889988,0cyclictest741-21lldpd19:18:023
245889987,1cyclictest743-21snmpd23:07:043
245889987,1cyclictest743-21snmpd22:18:543
245889987,1cyclictest743-21snmpd20:57:343
245889987,1cyclictest743-21snmpd00:33:413
245889987,1cyclictest743-21snmpd00:00:423
245889987,1cyclictest741-21lldpd20:31:013
245889987,1cyclictest741-21lldpd00:36:473
245889987,1cyclictest506-21systemd-resolve20:08:043
245889987,1cyclictest21190-21fschecks_time00:15:133
245889987,0cyclictest191rcu_preempt00:20:153
245889986,2cyclictest743-21snmpd22:25:033
245889986,2cyclictest743-21snmpd21:06:133
245889986,2cyclictest743-21snmpd20:00:013
245889986,2cyclictest743-21snmpd19:24:043
245889986,2cyclictest743-21snmpd00:26:343
245889984,2cyclictest0-21swapper/322:14:593
245829988,0cyclictest743-21snmpd21:56:312
245829988,0cyclictest743-21snmpd19:41:132
245829988,0cyclictest741-21lldpd23:35:162
245829988,0cyclictest741-21lldpd23:04:482
245829988,0cyclictest741-21lldpd20:16:212
245829988,0cyclictest741-21lldpd00:02:012
245829987,1cyclictest743-21snmpd22:35:152
245829987,1cyclictest743-21snmpd21:33:352
245829987,1cyclictest743-21snmpd20:27:122
245829987,1cyclictest741-21lldpd22:08:462
245829986,2cyclictest743-21snmpd23:40:422
245829986,2cyclictest743-21snmpd22:31:482
245829986,2cyclictest743-21snmpd20:45:012
245829986,2cyclictest743-21snmpd20:45:002
245829986,2cyclictest24619-21cat23:05:132
245789987,1cyclictest743-21snmpd23:23:381
245789986,2cyclictest16889-21kworker/1:0+events22:15:121
245789986,2cyclictest16889-21kworker/1:0+events19:25:161
245889977,0cyclictest743-21snmpd21:33:593
245889977,0cyclictest743-21snmpd20:54:543
245889977,0cyclictest743-21snmpd19:39:533
245889977,0cyclictest741-21lldpd22:54:393
245889977,0cyclictest522-21avahi-daemon00:08:353
245889976,1cyclictest1620-21munin-plugin-st23:30:003
245889976,0cyclictest191rcu_preempt23:40:153
245889976,0cyclictest191rcu_preempt23:03:463
245889974,3cyclictest10382-21apt-get23:50:123
245889974,2cyclictest244-20systemd-journal19:30:003
245889974,1cyclictest52-21ksoftirqd/321:00:133
245889973,2cyclictest52-21ksoftirqd/323:10:153
245889973,2cyclictest0-21swapper/319:40:163
245829977,0cyclictest743-21snmpd23:19:462
245829977,0cyclictest743-21snmpd22:53:012
245829977,0cyclictest743-21snmpd22:01:592
245829977,0cyclictest743-21snmpd20:23:442
245829977,0cyclictest741-21lldpd23:51:222
245829977,0cyclictest741-21lldpd22:11:452
245829977,0cyclictest741-21lldpd00:18:582
245829976,1cyclictest743-21snmpd21:51:052
245829976,1cyclictest743-21snmpd19:57:552
245829976,1cyclictest743-21snmpd19:49:462
245829976,1cyclictest743-21snmpd00:27:222
245829975,2cyclictest743-21snmpd23:57:542
245829975,2cyclictest743-21snmpd22:20:372
245829975,2cyclictest743-21snmpd22:17:182
245829975,2cyclictest743-21snmpd21:43:552
245829975,2cyclictest20560-21cat22:55:152
245829973,3cyclictest9684-21ntp_states21:10:162
245829973,3cyclictest32553-21fw_conntrack23:25:142
245789977,0cyclictest743-21snmpd22:10:031
245789977,0cyclictest741-21lldpd23:46:171
245789977,0cyclictest741-21lldpd22:00:551
245789977,0cyclictest741-21lldpd20:26:481
245789977,0cyclictest741-21lldpd20:02:511
245789977,0cyclictest741-21lldpd19:56:221
245789977,0cyclictest741-21lldpd00:10:311
245789976,1cyclictest743-21snmpd21:39:121
245789976,1cyclictest16889-21kworker/1:0+events23:25:191
245789976,1cyclictest16889-21kworker/1:0+events00:35:111
245789976,1cyclictest16889-21kworker/1:0+events00:30:121
245789973,3cyclictest3311-21ntp_states19:35:171
245889966,0cyclictest741-21lldpd22:37:203
245889966,0cyclictest741-21lldpd20:13:573
245889966,0cyclictest741-21lldpd19:29:483
245889966,0cyclictest522-21avahi-daemon20:26:203
245889966,0cyclictest27464-21gltestperf20:35:133
245889966,0cyclictest19163-21fschecks_time00:10:133
245889965,1cyclictest743-21snmpd21:45:493
245889965,1cyclictest743-21snmpd20:24:053
245889965,1cyclictest741-21lldpd19:57:213
245889965,0cyclictest191rcu_preempt23:45:193
245889965,0cyclictest191rcu_preempt22:08:263
245889965,0cyclictest191rcu_preempt21:51:163
245889965,0cyclictest191rcu_preempt20:45:163
245889965,0cyclictest191rcu_preempt20:45:153
245889965,0cyclictest191rcu_preempt20:19:003
245889964,2cyclictest743-21snmpd23:37:413
245889964,0cyclictest191rcu_preempt21:55:163
245889962,3cyclictest29441-21cat23:15:213
245889962,3cyclictest20429-21fw_packets22:55:133
245889962,3cyclictest17846-21cron22:49:593
245889962,3cyclictest16695-21users21:25:203
245889962,2cyclictest52-21ksoftirqd/321:20:153
245889962,2cyclictest0-21swapper/322:00:163
245889961,3cyclictest52-21ksoftirqd/323:30:133
245889961,3cyclictest52-21ksoftirqd/321:10:193
245889960,4cyclictest52-21ksoftirqd/323:24:593
245829966,0cyclictest743-21snmpd22:45:272
245829966,0cyclictest743-21snmpd22:41:132
245829966,0cyclictest743-21snmpd20:04:472
245829966,0cyclictest743-21snmpd19:25:542
245829966,0cyclictest741-21lldpd20:39:512
245829966,0cyclictest741-21lldpd00:20:432
245829966,0cyclictest741-21lldpd00:07:262
245829966,0cyclictest522-21avahi-daemon19:21:442
245829965,1cyclictest743-21snmpd20:53:572
245829964,2cyclictest743-21snmpd00:34:052
245829963,2cyclictest1045-21sed19:30:142
245829962,3cyclictest3087-21fw_packets20:55:122
245789966,0cyclictest16889-21kworker/1:0+events20:23:441
245789965,1cyclictest743-21snmpd21:40:511
245789965,1cyclictest741-21lldpd21:50:461
245789965,1cyclictest16889-21kworker/1:0+events23:40:161
245789965,1cyclictest16889-21kworker/1:0+events22:50:181
245789965,1cyclictest16889-21kworker/1:0+events20:05:161
245789962,3cyclictest3347-21memory20:55:141
245889954,1cyclictest11186-21gltestperf21:15:143
245889953,0cyclictest191rcu_preempt21:40:133
245889952,1cyclictest52-21ksoftirqd/323:55:193
245889951,2cyclictest244-20systemd-journal22:20:253
245889950,3cyclictest52-21ksoftirqd/320:40:203
245889950,3cyclictest52-21ksoftirqd/320:40:193
245889950,2cyclictest14454-21grep22:40:143
245829955,0cyclictest743-21snmpd21:05:082
245829954,1cyclictest743-21snmpd19:39:382
245829953,2cyclictest21206-21sed21:40:012
245829953,2cyclictest11613-21ntpq21:15:172
245829952,3cyclictest26491-21fw_forwarded_lo23:10:122
245829951,3cyclictest24377-21grep21:45:122
245829951,3cyclictest2178-21fw_forwarded_lo23:30:132
245829951,3cyclictest16712-21seq21:25:262
245829950,5cyclictest557-21NetworkManager21:21:142
245789955,0cyclictest741-21lldpd20:45:011
245789955,0cyclictest741-21lldpd20:45:011
245789955,0cyclictest22209-21cpu23:00:171
245789954,1cyclictest16889-21kworker/1:0+events20:35:141
245789954,1cyclictest16889-21kworker/1:0+events19:50:121
245789953,2cyclictest717-21ntpd21:25:011
245789953,2cyclictest16889-21kworker/1:0+events23:50:121
245789952,2cyclictest24820-21cat21:45:151
245789950,3cyclictest4917-21apt-get19:40:111
245829943,1cyclictest0-21swapper/223:20:122
245829942,2cyclictest717-21ntpd20:47:112
245829942,2cyclictest717-21ntpd20:47:102
245829942,2cyclictest557-21NetworkManager21:00:192
245829942,2cyclictest0-21swapper/220:10:122
245829941,2cyclictest8658-21sh23:45:182
245829941,2cyclictest29078-21wc00:35:112
245829941,2cyclictest27943-21timerwakeupswit19:15:202
245829940,3cyclictest8197-21diskstats22:25:122
245789943,1cyclictest16889-21kworker/1:0+events22:20:121
245789943,1cyclictest0-21swapper/119:45:131
245789941,2cyclictest9565-21ldconfig21:10:151
245789941,2cyclictest5969-21wc21:00:201
245789940,2cyclictest3898-21apt-get23:35:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional