You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-13 - 18:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Wed May 13, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28986991818,0cyclictest65850irq/126-lan11:57:021
28986991818,0cyclictest65850irq/126-lan11:30:121
28986991818,0cyclictest65850irq/126-lan10:36:431
28986991818,0cyclictest65850irq/126-lan07:35:191
28986991818,0cyclictest65850irq/126-lan07:34:161
28986991818,0cyclictest65850irq/126-lan07:25:121
28986991817,1cyclictest65850irq/126-lan12:31:161
28986991817,1cyclictest65850irq/126-lan08:35:171
28986991717,0cyclictest65850irq/126-lan12:35:171
28986991717,0cyclictest65850irq/126-lan12:10:141
28986991717,0cyclictest65850irq/126-lan09:50:121
28986991717,0cyclictest65850irq/126-lan09:35:161
28986991717,0cyclictest65850irq/126-lan09:26:191
28986991717,0cyclictest65850irq/126-lan09:05:581
28986991717,0cyclictest65850irq/126-lan09:03:431
28986991717,0cyclictest65850irq/126-lan08:50:321
28986991717,0cyclictest65850irq/126-lan08:20:151
28986991717,0cyclictest65850irq/126-lan07:23:221
28986991716,1cyclictest65850irq/126-lan11:50:111
28986991616,0cyclictest65850irq/126-lan12:17:511
28986991616,0cyclictest65850irq/126-lan12:05:171
28986991616,0cyclictest65850irq/126-lan11:40:161
28986991616,0cyclictest65850irq/126-lan11:15:111
28986991616,0cyclictest65850irq/126-lan11:14:561
28986991616,0cyclictest65850irq/126-lan10:25:211
28986991616,0cyclictest65850irq/126-lan10:22:461
28986991616,0cyclictest65850irq/126-lan10:05:201
28986991616,0cyclictest65850irq/126-lan10:01:171
28986991616,0cyclictest65850irq/126-lan09:55:171
28986991616,0cyclictest65850irq/126-lan09:17:231
28986991616,0cyclictest65850irq/126-lan09:10:201
28986991616,0cyclictest65850irq/126-lan08:55:231
28986991616,0cyclictest65850irq/126-lan08:49:131
28986991616,0cyclictest65850irq/126-lan08:25:131
28986991616,0cyclictest65850irq/126-lan08:10:171
28986991616,0cyclictest65850irq/126-lan07:15:491
28986991615,1cyclictest65850irq/126-lan12:20:121
28986991515,0cyclictest65850irq/126-lan11:05:191
28986991515,0cyclictest65850irq/126-lan10:15:181
28986991515,0cyclictest65850irq/126-lan09:20:141
28986991515,0cyclictest65850irq/126-lan08:40:181
28986991515,0cyclictest65850irq/126-lan08:30:111
28986991515,0cyclictest65850irq/126-lan08:05:111
28986991515,0cyclictest65850irq/126-lan08:00:171
28986991515,0cyclictest65850irq/126-lan07:44:491
28986991515,0cyclictest65850irq/126-lan07:10:211
28986991514,1cyclictest65850irq/126-lan10:54:421
28986991514,1cyclictest65850irq/126-lan09:45:141
28986991414,0cyclictest65850irq/126-lan10:59:291
28986991414,0cyclictest65850irq/126-lan09:30:151
28986991413,1cyclictest65850irq/126-lan12:25:111
28986991413,1cyclictest65850irq/126-lan11:25:131
28986991313,0cyclictest65850irq/126-lan11:20:151
28986991313,0cyclictest65850irq/126-lan10:45:201
28986991313,0cyclictest65850irq/126-lan10:31:431
28986991313,0cyclictest65850irq/126-lan07:50:161
28986991313,0cyclictest65850irq/126-lan07:45:121
28992991212,0cyclictest743-21snmpd12:33:132
28986991212,0cyclictest65850irq/126-lan11:45:161
28986991212,0cyclictest65850irq/126-lan07:55:121
28986991111,0cyclictest65850irq/126-lan09:40:171
28986991111,0cyclictest65850irq/126-lan08:17:461
28986991110,1cyclictest65850irq/126-lan12:00:111
2899299109,0cyclictest743-21snmpd09:47:532
2899299109,0cyclictest743-21snmpd07:44:192
28992991010,0cyclictest743-21snmpd12:37:392
28992991010,0cyclictest743-21snmpd12:12:492
28992991010,0cyclictest743-21snmpd11:07:592
28992991010,0cyclictest743-21snmpd09:04:582
28992991010,0cyclictest743-21snmpd08:06:502
2897899108,2cyclictest20887-21grep09:25:140
2897899107,3cyclictest743-21snmpd09:51:050
2897899107,3cyclictest743-21snmpd09:36:440
2897899104,6cyclictest743-21snmpd08:52:100
2897899104,2cyclictest743-21snmpd11:40:030
289969998,1cyclictest743-21snmpd12:15:563
289969998,1cyclictest743-21snmpd10:40:343
289969996,2cyclictest743-21snmpd09:35:243
289929999,0cyclictest743-21snmpd12:17:142
289929999,0cyclictest743-21snmpd11:50:572
289929999,0cyclictest743-21snmpd08:10:472
289929999,0cyclictest4413-21cat10:05:142
289929998,1cyclictest743-21snmpd07:49:022
289869999,0cyclictest65850irq/126-lan10:12:431
289869998,1cyclictest65850irq/126-lan11:35:161
289789997,2cyclictest741-21lldpd12:11:410
289789996,3cyclictest743-21snmpd10:43:020
289789996,3cyclictest743-21snmpd07:13:480
289789996,3cyclictest573-21in:imuxsock12:32:460
289789992,3cyclictest21048-21sort12:05:120
289969988,0cyclictest743-21snmpd10:54:053
289969988,0cyclictest743-21snmpd09:05:233
289969988,0cyclictest741-21lldpd11:41:003
289969988,0cyclictest741-21lldpd11:02:303
289969988,0cyclictest741-21lldpd09:20:103
289969988,0cyclictest741-21lldpd08:54:213
289969988,0cyclictest741-21lldpd07:12:493
289969987,1cyclictest741-21lldpd10:39:173
289969986,2cyclictest743-21snmpd12:04:293
289969986,2cyclictest743-21snmpd11:17:083
289969986,2cyclictest743-21snmpd10:13:573
289969986,2cyclictest743-21snmpd07:41:283
289929988,0cyclictest743-21snmpd12:20:162
289929988,0cyclictest743-21snmpd11:57:202
289929988,0cyclictest743-21snmpd11:41:342
289929988,0cyclictest743-21snmpd11:17:472
289929988,0cyclictest743-21snmpd11:12:032
289929988,0cyclictest743-21snmpd11:02:142
289929988,0cyclictest743-21snmpd10:47:312
289929988,0cyclictest743-21snmpd10:29:112
289929988,0cyclictest743-21snmpd09:35:512
289929988,0cyclictest743-21snmpd09:16:582
289929988,0cyclictest743-21snmpd08:52:432
289929988,0cyclictest743-21snmpd08:30:082
289929988,0cyclictest743-21snmpd07:15:582
289929988,0cyclictest741-21lldpd09:44:232
289929988,0cyclictest30749-21cat09:50:132
289929987,1cyclictest743-21snmpd10:10:272
289929986,2cyclictest743-21snmpd11:46:152
289929986,2cyclictest743-21snmpd11:21:472
289929986,2cyclictest743-21snmpd10:32:102
289929986,2cyclictest743-21snmpd08:47:452
289929986,2cyclictest743-21snmpd08:44:182
289929986,2cyclictest743-21snmpd07:34:172
289929986,2cyclictest18971-21cat10:40:142
289869988,0cyclictest65850irq/126-lan10:40:201
289789988,0cyclictest743-21snmpd11:53:060
289789988,0cyclictest741-21lldpd11:48:460
289789988,0cyclictest741-21lldpd11:12:480
289789988,0cyclictest741-21lldpd09:46:310
289789988,0cyclictest741-21lldpd09:19:510
289789987,1cyclictest743-21snmpd08:46:300
289789987,1cyclictest743-21snmpd07:19:480
289789986,2cyclictest743-21snmpd08:28:020
289789985,3cyclictest743-21snmpd07:53:280
289789985,3cyclictest717-21ntpd09:10:120
289789984,1cyclictest8498-21hddtemp_smartct08:55:130
289789984,1cyclictest522-21avahi-daemon11:57:440
289789984,0cyclictest0-21swapper/009:00:180
289789983,2cyclictest834-21tune2fs12:35:120
289789983,1cyclictest0-21swapper/011:05:200
289789982,2cyclictest2661-21wc08:40:150
289789982,2cyclictest25621-21grep08:20:130
289789982,2cyclictest18115-21head08:00:160
289789981,3cyclictest8435-21cat10:15:120
289789981,2cyclictest13467-21sed09:05:170
289789980,4cyclictest26649-21turbostat12:20:010
289969977,0cyclictest743-21snmpd12:34:043
289969977,0cyclictest743-21snmpd12:10:263
289969977,0cyclictest741-21lldpd11:31:233
289969977,0cyclictest741-21lldpd11:22:213
289969977,0cyclictest741-21lldpd10:32:483
289969977,0cyclictest741-21lldpd09:49:093
289969977,0cyclictest741-21lldpd08:36:343
289969977,0cyclictest741-21lldpd07:15:233
289969976,1cyclictest743-21snmpd09:16:193
289969976,1cyclictest743-21snmpd08:31:023
289969976,1cyclictest741-21lldpd08:16:443
289969976,1cyclictest522-21avahi-daemon07:46:143
289969975,2cyclictest743-21snmpd12:35:423
289969975,2cyclictest743-21snmpd11:26:493
289969975,2cyclictest743-21snmpd09:42:143
289969975,2cyclictest743-21snmpd09:12:343
289969975,2cyclictest743-21snmpd08:03:363
289969975,2cyclictest31495-21cat11:10:163
289929977,0cyclictest9189-21cat11:35:142
289929977,0cyclictest8542-21cat08:55:132
289929977,0cyclictest743-21snmpd10:01:182
289929977,0cyclictest743-21snmpd07:36:522
289929977,0cyclictest741-21lldpd12:00:022
289929977,0cyclictest741-21lldpd10:52:082
289929976,1cyclictest743-21snmpd10:15:272
289929975,2cyclictest743-21snmpd09:55:262
289929973,3cyclictest15017-21ntpq09:10:172
289929972,5cyclictest557-21NetworkManager11:33:382
289789977,0cyclictest743-21snmpd10:38:550
289789977,0cyclictest743-21snmpd08:38:460
289789977,0cyclictest741-21lldpd12:29:500
289789977,0cyclictest741-21lldpd08:09:250
289789977,0cyclictest522-21avahi-daemon12:02:290
289789976,1cyclictest743-21snmpd11:31:130
289789976,1cyclictest743-21snmpd10:06:390
289789976,1cyclictest2928-21fschecks_count11:20:130
289789975,2cyclictest743-21snmpd07:55:100
289789975,2cyclictest743-21snmpd07:20:030
289789972,2cyclictest743-21snmpd10:30:430
289789972,2cyclictest3840-21sendmail_mailqu07:25:180
289789972,2cyclictest27408-21ntpq11:00:170
289789971,3cyclictest557-21NetworkManager07:49:570
289789971,2cyclictest7302-21cat07:35:140
289789971,2cyclictest6154-21df10:10:120
289789971,2cyclictest11330-21sed10:20:190
289789970,4cyclictest19044-21ntpq09:20:160
289969966,0cyclictest743-21snmpd08:24:203
289969966,0cyclictest741-21lldpd08:41:143
289969966,0cyclictest207-21jbd2/nvme0n1p2-812:27:153
289969965,1cyclictest743-21snmpd09:33:563
289969965,1cyclictest743-21snmpd08:55:573
289969965,1cyclictest4427-21sed08:45:133
289969965,1cyclictest20627-21cpuspeed_turbos10:45:123
289969964,2cyclictest743-21snmpd09:50:303
289969964,2cyclictest743-21snmpd09:03:013
289969963,3cyclictest15987-21memory07:55:143
289969962,3cyclictest18167-21sed11:55:213
289969962,3cyclictest13153-21grep11:45:123
289929966,0cyclictest743-21snmpd08:39:462
289929965,1cyclictest743-21snmpd10:35:282
289929964,2cyclictest743-21snmpd07:27:332
289929963,3cyclictest834-21apt-get07:20:122
289929963,2cyclictest26341-21systemctl11:00:012
289929962,2cyclictest22157-21cat09:30:002
289789966,0cyclictest741-21lldpd09:30:430
289789965,1cyclictest743-21snmpd10:25:070
289789965,1cyclictest743-21snmpd09:58:280
289789964,2cyclictest743-21snmpd07:40:310
289789963,3cyclictest21657-21entropy08:10:120
289789961,2cyclictest743-21snmpd10:58:150
289789961,2cyclictest26722-21cat09:40:150
289789960,3cyclictest2270-21fw_forwarded_lo10:00:130
289969955,0cyclictest741-21lldpd09:57:373
289969955,0cyclictest741-21lldpd08:29:243
289969955,0cyclictest741-21lldpd08:10:243
289969955,0cyclictest741-21lldpd07:51:023
289969954,1cyclictest741-21lldpd10:26:023
289969953,2cyclictest743-21snmpd11:05:563
289969953,2cyclictest743-21snmpd10:05:073
289969953,2cyclictest743-21snmpd10:00:273
289969953,2cyclictest557-21NetworkManager07:20:163
289969952,3cyclictest7535-21needreboot07:35:163
289969952,2cyclictest24580-21dpkg10:55:113
289969952,2cyclictest21989-21wc12:05:193
289969950,4cyclictest27483-21memory12:20:143
289969950,4cyclictest21052-21ntpq09:25:153
289969950,4cyclictest10876-21ntpq10:20:173
289929955,0cyclictest743-21snmpd11:29:432
289929954,1cyclictest743-21snmpd07:13:392
289929954,1cyclictest28828-21ntpq08:25:172
289929954,1cyclictest12992-21ntpq09:05:152
289929954,1cyclictest10349-21gltestperf10:20:122
289929953,2cyclictest717-21ntpd08:00:132
289929952,2cyclictest19651-21seq09:21:142
289869955,0cyclictest65850irq/126-lan11:00:211
289789955,0cyclictest522-21avahi-daemon11:17:570
289789953,2cyclictest9588-21ntpq11:35:170
289789953,2cyclictest743-21snmpd10:54:490
289789953,0cyclictest743-21snmpd07:31:570
289789952,2cyclictest5083-21sed11:25:130
289789952,2cyclictest28062-21sed12:20:210
289969942,2cyclictest557-21NetworkManager07:25:143
289969942,2cyclictest20484-21mailstats08:05:173
289969941,2cyclictest8774-21collect210:15:153
289969941,2cyclictest15591-21sed11:50:153
289969940,3cyclictest8926-21diskstats11:35:123
289969940,3cyclictest4856-21/usr/sbin/munin07:30:123
289929942,2cyclictest717-21ntpd12:05:072
289929942,2cyclictest29374-21cat12:25:132
289929941,2cyclictest26283-21ld08:20:162
289929941,2cyclictest15432-21apt-get07:55:112
289929941,2cyclictest13809-21sh07:50:142
289929940,4cyclictest24361-21ntpq08:15:172
289929940,3cyclictest22412-21diskstats09:30:122
289789944,0cyclictest0-21swapper/008:15:170
289789943,1cyclictest31742-21latency_hist08:35:000
289789940,4cyclictest21288-21ntpq10:45:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional