You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 17:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Fri Jun 12, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7932991918,1cyclictest65850irq/126-lan11:40:011
7932991817,1cyclictest65850irq/126-lan10:10:121
7932991817,1cyclictest65850irq/126-lan08:40:221
7932991817,1cyclictest65850irq/126-lan08:20:211
7932991817,1cyclictest65850irq/126-lan07:55:171
7932991717,0cyclictest65850irq/126-lan11:55:011
7932991717,0cyclictest65850irq/126-lan09:29:251
7932991717,0cyclictest65850irq/126-lan07:10:161
7932991716,1cyclictest65850irq/126-lan12:35:121
7932991716,1cyclictest65850irq/126-lan12:05:161
7932991716,1cyclictest65850irq/126-lan09:50:201
7932991716,1cyclictest65850irq/126-lan07:45:141
7932991616,0cyclictest65850irq/126-lan12:30:091
7932991616,0cyclictest65850irq/126-lan12:15:131
7932991616,0cyclictest65850irq/126-lan09:45:171
7932991616,0cyclictest65850irq/126-lan08:00:141
7932991615,1cyclictest65850irq/126-lan11:20:121
7932991615,1cyclictest65850irq/126-lan11:10:121
7932991615,1cyclictest65850irq/126-lan10:20:171
7932991615,1cyclictest65850irq/126-lan10:15:171
7932991615,1cyclictest65850irq/126-lan09:15:161
7932991615,1cyclictest65850irq/126-lan08:45:241
7932991615,1cyclictest65850irq/126-lan08:05:231
7932991615,1cyclictest65850irq/126-lan07:40:131
7932991615,1cyclictest65850irq/126-lan07:20:001
7932991515,0cyclictest65850irq/126-lan11:45:131
7932991515,0cyclictest65850irq/126-lan11:30:191
7932991515,0cyclictest65850irq/126-lan10:06:261
7932991514,1cyclictest65850irq/126-lan12:00:121
7932991514,1cyclictest65850irq/126-lan11:54:241
7932991514,1cyclictest65850irq/126-lan11:15:091
7932991514,1cyclictest65850irq/126-lan10:50:211
7932991514,1cyclictest65850irq/126-lan10:40:161
7932991514,1cyclictest65850irq/126-lan10:25:171
7932991514,1cyclictest65850irq/126-lan09:40:161
7932991514,1cyclictest65850irq/126-lan09:35:121
7932991514,1cyclictest65850irq/126-lan07:35:151
7932991414,0cyclictest65850irq/126-lan10:30:121
7932991414,0cyclictest65850irq/126-lan09:00:011
7932991414,0cyclictest65850irq/126-lan08:10:131
7932991413,1cyclictest65850irq/126-lan11:35:191
7932991413,1cyclictest65850irq/126-lan11:00:131
7932991413,1cyclictest65850irq/126-lan10:45:161
7932991413,1cyclictest65850irq/126-lan10:35:201
7932991413,1cyclictest65850irq/126-lan09:20:131
793699132,7cyclictest20630-21seq08:57:322
7932991313,0cyclictest65850irq/126-lan10:56:251
7932991313,0cyclictest65850irq/126-lan08:55:181
7932991313,0cyclictest65850irq/126-lan08:50:181
7932991313,0cyclictest65850irq/126-lan08:35:221
7932991313,0cyclictest65850irq/126-lan08:28:261
7932991313,0cyclictest65850irq/126-lan07:52:251
7932991313,0cyclictest65850irq/126-lan07:20:201
7932991312,1cyclictest65850irq/126-lan10:00:141
7932991312,1cyclictest65850irq/126-lan09:15:001
7932991312,1cyclictest65850irq/126-lan08:30:111
7932991312,1cyclictest65850irq/126-lan07:30:201
7932991212,0cyclictest65850irq/126-lan12:20:131
792799128,4cyclictest22464-21cut11:40:000
793699114,4cyclictest22742-21cat07:45:142
793699112,6cyclictest14502-21seq08:42:152
7932991111,0cyclictest65850irq/126-lan07:27:251
792799110,7cyclictest8792-21mailstats09:45:190
792799110,6cyclictest1587-21taskset10:48:010
793699108,2cyclictest743-21snmpd10:20:452
793699108,2cyclictest743-21snmpd08:38:082
793699108,2cyclictest743-21snmpd08:06:402
793699100,6cyclictest23847-21ntpq09:05:162
793299109,1cyclictest65850irq/126-lan09:55:131
793299109,1cyclictest65850irq/126-lan08:15:131
7932991010,0cyclictest65850irq/126-lan11:05:091
7932991010,0cyclictest65850irq/126-lan09:30:251
792799108,2cyclictest741-21lldpd12:29:320
792799106,4cyclictest743-21snmpd09:08:420
792799105,5cyclictest6587-21cat11:00:150
792799102,7cyclictest557-21NetworkManager07:34:080
792799100,8cyclictest3676-21/usr/sbin/munin09:35:100
792799100,8cyclictest25886-21seq07:52:510
792799100,8cyclictest21406-21cat07:40:230
792799100,6cyclictest32282-21cut10:45:000
792799100,6cyclictest31697-21taskset09:23:550
792799100,6cyclictest30170-21cut10:40:000
792799100,6cyclictest21314-21grep10:15:200
792799100,6cyclictest17606-21awk11:25:200
792799100,6cyclictest12724-21vmstat12:30:190
79419998,1cyclictest743-21snmpd08:16:523
79419998,1cyclictest741-21lldpd08:52:413
79419996,3cyclictest743-21snmpd08:03:253
79369998,1cyclictest741-21lldpd09:35:132
79369997,2cyclictest743-21snmpd11:03:132
79369996,3cyclictest743-21snmpd10:34:422
79369996,2cyclictest743-21snmpd07:34:482
79369993,3cyclictest0-21swapper/210:05:032
79369990,2cyclictest2893-21taskset12:08:362
79369990,2cyclictest19251-21grep07:35:222
79369990,2cyclictest18671-21sort10:10:122
79329998,1cyclictest65850irq/126-lan09:05:181
79279998,1cyclictest743-21snmpd11:41:180
79279998,1cyclictest743-21snmpd10:59:160
79279997,2cyclictest743-21snmpd07:22:060
79279995,4cyclictest743-21snmpd11:55:470
79279990,7cyclictest15567-21taskset07:25:310
79279990,6cyclictest747-21runrttasks11:21:330
79279990,6cyclictest4968-21taskset12:14:260
79279990,6cyclictest1738-21taskset08:15:000
79279990,6cyclictest16666-21taskset08:49:110
79279990,5cyclictest5706-21taskset09:40:090
79279990,5cyclictest11605-21taskset11:10:560
79279990,5cyclictest10508-21taskset08:32:520
79419988,0cyclictest743-21snmpd10:05:323
79419988,0cyclictest743-21snmpd09:17:073
79419988,0cyclictest741-21lldpd12:35:443
79419988,0cyclictest741-21lldpd09:29:473
79419988,0cyclictest741-21lldpd08:20:023
79419987,1cyclictest743-21snmpd11:20:263
79419987,1cyclictest743-21snmpd08:46:173
79419987,1cyclictest741-21lldpd12:20:003
79419987,1cyclictest506-21systemd-resolve11:55:163
79419986,2cyclictest743-21snmpd11:51:203
79419986,2cyclictest743-21snmpd11:36:593
79419986,2cyclictest743-21snmpd08:31:593
79369988,0cyclictest743-21snmpd11:07:072
79369988,0cyclictest743-21snmpd10:09:352
79369988,0cyclictest743-21snmpd07:51:462
79369988,0cyclictest741-21lldpd11:43:352
79369988,0cyclictest741-21lldpd10:52:382
79369988,0cyclictest741-21lldpd10:44:322
79369988,0cyclictest741-21lldpd07:28:392
79369986,2cyclictest743-21snmpd11:27:352
79369986,2cyclictest743-21snmpd09:42:102
79369986,2cyclictest743-21snmpd09:30:222
79369986,2cyclictest21131-21cat11:35:132
79369985,2cyclictest28784-21cat10:35:152
79369983,5cyclictest244-20systemd-journal10:25:112
79369980,3cyclictest10490-21ntpq09:50:182
79369980,2cyclictest9380-21taskset09:48:392
79369980,2cyclictest903-21chrt12:03:542
79369980,2cyclictest5747-21taskset10:58:362
79369980,2cyclictest4821-21taskset12:12:342
79369980,2cyclictest31722-21chrt09:24:152
79369980,2cyclictest26776-21taskset09:13:372
79369980,2cyclictest25694-21wc11:45:142
79369980,2cyclictest22004-21chrt10:19:472
79369980,2cyclictest21929-21awk09:00:182
79369980,2cyclictest15915-21chrt11:24:162
79369980,2cyclictest13274-21taskset09:56:562
79369980,2cyclictest0-21swapper/209:25:162
79369980,1cyclictest286102sleep211:51:092
79329988,0cyclictest743-21snmpd12:12:371
79329988,0cyclictest741-21lldpd12:28:181
79279988,0cyclictest743-21snmpd12:02:510
79279988,0cyclictest743-21snmpd08:26:290
79279988,0cyclictest741-21lldpd09:27:590
79279987,1cyclictest743-21snmpd12:19:390
79279987,1cyclictest743-21snmpd12:05:270
79279987,1cyclictest743-21snmpd08:07:490
79279986,2cyclictest741-21lldpd09:59:580
79279986,2cyclictest741-21lldpd09:51:210
79279983,4cyclictest743-21snmpd10:25:120
79279981,7cyclictest4265-21cat08:20:000
79279981,4cyclictest27274-21proc_pri07:55:170
79279980,7cyclictest21676-21sed09:00:160
79279980,6cyclictest17093-21ntpq10:05:170
79279980,6cyclictest0-21swapper/011:53:060
79279980,5cyclictest29914-21taskset08:02:390
79279980,5cyclictest25122-21taskset09:10:050
79279980,5cyclictest18827-21wc11:30:140
79279980,5cyclictest16974-21taskset08:50:000
79279980,5cyclictest15095-21ntp_states10:00:170
79279980,5cyclictest13670-21taskset11:16:370
79279980,5cyclictest0-21swapper/012:35:180
79279980,5cyclictest0-21swapper/011:45:490
79279980,5cyclictest0-21swapper/008:40:190
79279980,4cyclictest8980-21ntpq07:10:170
79279980,4cyclictest19890-21ld08:55:160
79279980,4cyclictest12509-21taskset08:37:440
79279980,2cyclictest3750-21runrttasks10:53:460
79279980,2cyclictest2797-21grep09:30:210
79419977,0cyclictest743-21snmpd07:48:013
79419977,0cyclictest743-21snmpd07:38:483
79419977,0cyclictest741-21lldpd11:47:153
79419977,0cyclictest741-21lldpd11:40:233
79419977,0cyclictest741-21lldpd11:05:513
79419977,0cyclictest741-21lldpd10:34:483
79419977,0cyclictest741-21lldpd09:55:463
79419977,0cyclictest741-21lldpd09:22:213
79419977,0cyclictest741-21lldpd08:40:343
79419977,0cyclictest741-21lldpd07:43:523
79419976,1cyclictest743-21snmpd09:37:223
79419976,1cyclictest743-21snmpd07:27:573
79419976,1cyclictest522-21avahi-daemon12:30:133
79419976,1cyclictest522-21avahi-daemon10:37:333
79419976,1cyclictest20216-21latency_hist11:35:003
79419976,1cyclictest19216-21cut08:55:113
79419975,2cyclictest743-21snmpd09:49:323
79419975,2cyclictest743-21snmpd07:59:163
79419975,2cyclictest743-21snmpd07:53:253
79419974,2cyclictest244-20systemd-journal12:20:213
79369977,0cyclictest743-21snmpd12:28:372
79369977,0cyclictest741-21lldpd07:24:472
79369976,1cyclictest717-21ntpd12:20:162
79369975,2cyclictest743-21snmpd12:16:122
79369975,2cyclictest743-21snmpd08:25:082
79369974,3cyclictest28797-21cat08:00:132
79369972,5cyclictest9372-21if_lan08:30:142
79369972,4cyclictest26543-21uniq07:55:112
79369971,5cyclictest557-21NetworkManager11:11:022
79369970,4cyclictest14913-21seq12:37:262
79369970,3cyclictest5331-21ntp_states08:20:182
79369970,3cyclictest3160-21/usr/sbin/munin08:15:162
79369970,3cyclictest19008-21ntpq11:30:152
79369970,3cyclictest15843-21ntpq08:45:192
79369970,2cyclictest557-21NetworkManager08:10:312
79369970,2cyclictest20734-21chrt07:40:162
79369970,2cyclictest16980-21chrt08:50:052
79369970,0cyclictest8969-21ntp_states07:10:172
79369970,0cyclictest117242sleep207:18:072
79369970,0cyclictest0-21swapper/211:55:392
79329977,0cyclictest741-21lldpd11:28:331
79279973,4cyclictest19076-21gcc10:10:150
79279971,5cyclictest27760-21diskstats09:15:130
79279970,7cyclictest8332-21df11:05:090
79279970,6cyclictest22485-21diskstats10:20:110
79279970,4cyclictest4441-21taskset08:20:020
79279970,4cyclictest19383-21sed07:35:230
79279970,4cyclictest0-21swapper/010:30:230
79279970,4cyclictest0-21swapper/007:45:080
79279970,3cyclictest11097-21/usr/sbin/munin07:15:180
79419966,0cyclictest743-21snmpd10:45:183
79419966,0cyclictest741-21lldpd12:10:303
79419966,0cyclictest741-21lldpd12:00:533
79419966,0cyclictest741-21lldpd10:29:283
79419966,0cyclictest741-21lldpd09:43:473
79419966,0cyclictest741-21lldpd09:30:533
79419965,1cyclictest522-21avahi-daemon08:06:493
79419965,1cyclictest21203-21cpuspeed_turbos09:00:133
79419965,1cyclictest16592-21gltestperf11:25:123
79419965,1cyclictest10623-21cat11:10:143
79419964,2cyclictest743-21snmpd12:08:393
79419964,2cyclictest743-21snmpd10:50:563
79419964,2cyclictest743-21snmpd07:30:453
79419964,2cyclictest743-21snmpd07:12:173
79369963,3cyclictest27218-21apt-key09:15:002
79369960,3cyclictest341-21ls10:45:132
79369960,3cyclictest12540-21wc12:30:192
79369960,3cyclictest12426-21grep11:15:102
79279960,6cyclictest7852-21/usr/sbin/munin12:20:140
79419955,0cyclictest522-21avahi-daemon10:10:033
79419954,1cyclictest743-21snmpd09:54:173
79419954,1cyclictest743-21snmpd08:12:163
79419953,2cyclictest743-21snmpd11:16:583
79419953,2cyclictest743-21snmpd10:01:053
79419952,2cyclictest8438-21latency_hist08:30:003
79419952,2cyclictest5500-21seq10:55:283
79419952,2cyclictest10511-21sed12:25:213
79419950,4cyclictest6969-21ntpq11:00:183
79419944,0cyclictest522-21avahi-daemon10:20:053
79419943,1cyclictest23365-21fschecks_count09:05:133
79419941,2cyclictest25428-21grep09:10:133
79419941,2cyclictest20303-21cpu10:15:113
79419941,2cyclictest11393-21if_lan08:35:143
79419941,2cyclictest10277-21tr07:15:123
79419940,4cyclictest31122-21ntpq10:40:163
79419940,3cyclictest12382-21fschecks_count07:20:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional