You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-11 - 07:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Mon May 11, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8655991817,1cyclictest65850irq/126-lan00:35:141
8655991717,0cyclictest65850irq/126-lan23:55:111
8655991716,1cyclictest65850irq/126-lan22:20:161
8655991716,1cyclictest65850irq/126-lan21:50:141
8655991716,1cyclictest65850irq/126-lan21:42:271
8655991716,1cyclictest65850irq/126-lan20:20:161
8655991716,1cyclictest65850irq/126-lan19:25:191
8655991716,1cyclictest65850irq/126-lan00:05:131
8655991616,0cyclictest65850irq/126-lan21:30:261
8655991616,0cyclictest65850irq/126-lan19:16:231
8655991615,1cyclictest65850irq/126-lan23:50:211
8655991615,1cyclictest65850irq/126-lan23:32:101
8655991615,1cyclictest65850irq/126-lan23:10:111
8655991615,1cyclictest65850irq/126-lan22:35:141
8655991615,1cyclictest65850irq/126-lan21:35:141
8655991615,1cyclictest65850irq/126-lan21:15:161
8655991615,1cyclictest65850irq/126-lan00:15:121
8655991515,0cyclictest65850irq/126-lan23:20:211
8655991515,0cyclictest65850irq/126-lan23:15:221
8655991515,0cyclictest65850irq/126-lan22:55:001
8655991515,0cyclictest65850irq/126-lan22:14:261
8655991515,0cyclictest65850irq/126-lan21:55:171
8655991515,0cyclictest65850irq/126-lan19:35:151
8655991514,1cyclictest65850irq/126-lan23:50:001
8655991514,1cyclictest65850irq/126-lan22:30:131
8655991514,1cyclictest65850irq/126-lan22:15:141
8655991514,1cyclictest65850irq/126-lan21:25:201
8655991514,1cyclictest65850irq/126-lan20:55:161
8655991514,1cyclictest65850irq/126-lan20:45:191
8655991514,1cyclictest65850irq/126-lan20:25:141
8655991514,1cyclictest65850irq/126-lan19:55:141
8655991514,1cyclictest65850irq/126-lan19:45:211
8655991513,1cyclictest65850irq/126-lan19:40:121
8655991414,0cyclictest65850irq/126-lan22:40:151
8655991414,0cyclictest65850irq/126-lan21:03:271
8655991414,0cyclictest65850irq/126-lan00:24:051
8655991413,1cyclictest65850irq/126-lan23:35:171
8655991413,1cyclictest65850irq/126-lan22:50:191
8655991413,1cyclictest65850irq/126-lan20:20:011
8655991313,0cyclictest65850irq/126-lan20:40:161
8655991313,0cyclictest65850irq/126-lan20:10:201
8655991313,0cyclictest65850irq/126-lan20:05:201
8655991312,1cyclictest65850irq/126-lan21:06:421
8655991212,0cyclictest65850irq/126-lan22:49:261
8655991212,0cyclictest65850irq/126-lan00:10:121
8655991211,1cyclictest65850irq/126-lan22:00:141
8655991211,1cyclictest65850irq/126-lan21:45:201
8655991111,0cyclictest65850irq/126-lan21:10:151
8655991110,1cyclictest65850irq/126-lan23:40:201
8655991110,1cyclictest65850irq/126-lan23:25:191
8655991110,1cyclictest65850irq/126-lan20:50:171
8655991110,1cyclictest65850irq/126-lan20:50:171
8655991110,1cyclictest65850irq/126-lan20:30:151
8655991110,1cyclictest65850irq/126-lan00:30:181
8655991110,1cyclictest65850irq/126-lan00:25:141
865599109,1cyclictest65850irq/126-lan22:05:221
865599109,1cyclictest65850irq/126-lan19:34:271
8655991010,0cyclictest65850irq/126-lan23:05:131
8655991010,0cyclictest65850irq/126-lan22:25:131
8655991010,0cyclictest65850irq/126-lan20:00:171
8655991010,0cyclictest65850irq/126-lan19:20:181
8655991010,0cyclictest65850irq/126-lan00:00:171
86669998,1cyclictest741-21lldpd23:56:443
86669996,3cyclictest743-21snmpd21:37:023
86609998,1cyclictest743-21snmpd22:50:442
86609998,1cyclictest743-21snmpd21:33:262
86609996,3cyclictest717-21ntpd20:05:382
86559999,0cyclictest65850irq/126-lan19:50:131
86559998,1cyclictest65850irq/126-lan23:00:161
86559992,5cyclictest11655-21irqstats20:35:141
86559992,3cyclictest30031-21tune2fs21:20:121
86669988,0cyclictest743-21snmpd22:14:463
86669988,0cyclictest743-21snmpd21:11:263
86669988,0cyclictest741-21lldpd23:54:083
86669988,0cyclictest741-21lldpd19:50:583
86669988,0cyclictest741-21lldpd19:44:023
86669986,2cyclictest743-21snmpd21:51:093
86669986,2cyclictest743-21snmpd21:01:033
86669986,2cyclictest743-21snmpd20:59:193
86669985,3cyclictest743-21snmpd19:15:483
86669985,3cyclictest743-21snmpd00:01:343
86609988,0cyclictest743-21snmpd23:40:582
86609988,0cyclictest743-21snmpd21:49:572
86609988,0cyclictest743-21snmpd00:28:262
86609988,0cyclictest741-21lldpd23:51:362
86609988,0cyclictest741-21lldpd23:48:242
86609988,0cyclictest741-21lldpd22:22:282
86609988,0cyclictest741-21lldpd21:29:052
86609988,0cyclictest741-21lldpd20:40:092
86609988,0cyclictest741-21lldpd20:37:342
86609987,1cyclictest743-21snmpd23:21:392
86609987,1cyclictest743-21snmpd21:17:532
86609987,1cyclictest743-21snmpd21:10:442
86609986,2cyclictest743-21snmpd19:15:512
86609986,2cyclictest743-21snmpd19:12:552
86609986,2cyclictest717-21ntpd23:58:002
86609986,2cyclictest717-21ntpd22:17:452
86609986,2cyclictest717-21ntpd22:14:452
86609986,2cyclictest717-21ntpd19:58:192
86609986,2cyclictest717-21ntpd19:51:012
86609986,2cyclictest717-21ntpd19:40:062
86609986,2cyclictest717-21ntpd19:35:582
86609986,2cyclictest717-21ntpd19:32:592
86609986,2cyclictest717-21ntpd19:25:042
86609986,2cyclictest717-21ntpd19:23:562
86609986,2cyclictest717-21ntpd00:10:062
86609986,2cyclictest717-21ntpd00:06:222
86609986,2cyclictest717-21ntpd00:03:422
86559982,4cyclictest9258-21if_err_lan19:10:141
86509988,0cyclictest743-21snmpd21:20:520
86509988,0cyclictest743-21snmpd20:42:310
86509988,0cyclictest743-21snmpd19:44:230
86509988,0cyclictest741-21lldpd23:23:010
86509988,0cyclictest741-21lldpd19:55:240
86509988,0cyclictest741-21lldpd00:20:340
86509987,1cyclictest743-21snmpd23:49:070
86509987,1cyclictest743-21snmpd23:18:300
86509987,1cyclictest743-21snmpd20:49:490
86509987,1cyclictest741-21lldpd23:57:060
86509987,1cyclictest741-21lldpd22:46:390
86509986,2cyclictest743-21snmpd22:41:520
86509986,2cyclictest743-21snmpd21:02:460
86509986,2cyclictest743-21snmpd20:37:070
86509985,3cyclictest743-21snmpd19:46:260
86669977,0cyclictest743-21snmpd22:26:403
86669977,0cyclictest743-21snmpd22:03:003
86669977,0cyclictest743-21snmpd20:47:193
86669977,0cyclictest743-21snmpd00:20:353
86669977,0cyclictest741-21lldpd23:48:403
86669977,0cyclictest741-21lldpd23:12:433
86669977,0cyclictest741-21lldpd21:48:003
86669977,0cyclictest741-21lldpd20:19:143
86669976,1cyclictest743-21snmpd23:06:353
86669976,1cyclictest743-21snmpd21:42:213
86669976,1cyclictest743-21snmpd00:18:383
86669976,1cyclictest741-21lldpd22:40:373
86669976,1cyclictest506-21systemd-resolve22:38:003
86669975,2cyclictest743-21snmpd23:26:573
86669975,2cyclictest743-21snmpd23:04:053
86669975,2cyclictest743-21snmpd22:23:063
86669975,2cyclictest743-21snmpd20:37:423
86669975,2cyclictest743-21snmpd00:36:303
86609977,0cyclictest743-21snmpd20:56:132
86609977,0cyclictest741-21lldpd23:16:452
86609977,0cyclictest741-21lldpd23:08:012
86609977,0cyclictest741-21lldpd23:00:422
86609977,0cyclictest741-21lldpd22:33:482
86609977,0cyclictest741-21lldpd21:56:042
86609976,1cyclictest743-21snmpd20:49:132
86609976,1cyclictest741-21lldpd20:16:282
86609976,1cyclictest16248-21grep22:05:152
86609975,2cyclictest743-21snmpd19:45:502
86609975,2cyclictest717-21ntpd23:10:092
86609975,2cyclictest717-21ntpd21:20:092
86609975,2cyclictest717-21ntpd20:30:372
86609975,2cyclictest717-21ntpd20:00:112
86609975,2cyclictest717-21ntpd00:15:042
86509977,0cyclictest743-21snmpd23:50:400
86509977,0cyclictest743-21snmpd21:38:490
86509977,0cyclictest743-21snmpd20:26:540
86509977,0cyclictest743-21snmpd19:23:090
86509977,0cyclictest743-21snmpd00:03:210
86509977,0cyclictest741-21lldpd23:35:050
86509977,0cyclictest741-21lldpd23:30:420
86509977,0cyclictest741-21lldpd22:06:480
86509977,0cyclictest741-21lldpd21:31:060
86509977,0cyclictest741-21lldpd21:14:410
86509977,0cyclictest741-21lldpd19:31:220
86509976,1cyclictest743-21snmpd20:19:090
86509976,1cyclictest741-21lldpd21:40:220
86509976,1cyclictest575-21rs:main0
86509975,2cyclictest743-21snmpd22:32:580
86509975,2cyclictest743-21snmpd22:19:040
86509975,2cyclictest743-21snmpd22:10:510
86509975,2cyclictest743-21snmpd21:15:110
86509975,2cyclictest24192-21cat21:05:150
86669966,0cyclictest743-21snmpd22:45:323
86669966,0cyclictest743-21snmpd20:21:293
86669966,0cyclictest743-21snmpd00:14:593
86669966,0cyclictest741-21lldpd23:18:153
86669966,0cyclictest741-21lldpd21:20:353
86669966,0cyclictest741-21lldpd20:50:313
86669966,0cyclictest741-21lldpd20:50:303
86669966,0cyclictest741-21lldpd19:23:563
86669965,1cyclictest743-21snmpd20:42:013
86669964,2cyclictest743-21snmpd21:34:023
86669964,2cyclictest20395-21cat23:35:163
86669963,3cyclictest743-21snmpd22:08:123
86669963,3cyclictest557-21NetworkManager22:56:323
86669963,3cyclictest24228-21sed19:45:203
86669962,3cyclictest9876-21grep19:10:203
86669962,3cyclictest24780-21grep21:05:223
86669962,3cyclictest10424-21wc00:30:153
86669961,5cyclictest557-21NetworkManager20:11:573
86609966,0cyclictest743-21snmpd23:30:242
86609966,0cyclictest743-21snmpd22:29:342
86609966,0cyclictest741-21lldpd22:04:102
86609965,1cyclictest741-21lldpd21:36:152
86609965,1cyclictest5562-21cpuspeed_turbos21:40:122
86609964,2cyclictest743-21snmpd23:38:282
86609963,3cyclictest6947-21sed00:20:202
86509966,0cyclictest743-21snmpd23:14:390
86509966,0cyclictest743-21snmpd00:25:230
86509966,0cyclictest741-21lldpd19:15:040
86509966,0cyclictest741-21lldpd00:19:140
86509966,0cyclictest522-21avahi-daemon22:59:510
86509965,1cyclictest743-21snmpd21:46:390
86509965,1cyclictest743-21snmpd20:14:540
86509965,1cyclictest743-21snmpd00:39:030
86509965,1cyclictest743-21snmpd00:09:530
86509965,1cyclictest522-21avahi-daemon21:27:460
86509964,2cyclictest743-21snmpd22:02:420
86509964,2cyclictest743-21snmpd20:30:090
86669955,0cyclictest741-21lldpd22:34:223
86669955,0cyclictest741-21lldpd20:25:353
86669955,0cyclictest522-21avahi-daemon20:07:143
86669954,1cyclictest506-21systemd-resolve20:34:263
86669953,2cyclictest743-21snmpd23:43:213
86669953,2cyclictest743-21snmpd19:56:143
86669953,2cyclictest18936-21apt-get19:35:123
86669953,2cyclictest14722-21ntpq23:20:173
86669952,3cyclictest456-21ntpq00:05:173
86669952,3cyclictest20952-21uptime22:15:213
86669952,3cyclictest11841-21grep21:55:143
86669952,2cyclictest8683-21ld00:25:183
86669952,2cyclictest717-21ntpd20:00:183
86669952,2cyclictest244-20systemd-journal22:51:023
86669951,3cyclictest743-21snmpd21:25:113
86609954,1cyclictest743-21snmpd20:24:322
86609954,1cyclictest23818-21cpuspeed_turbos21:05:142
86609952,2cyclictest15934-21apt-get23:25:082
86609951,3cyclictest5094-21awk22:55:212
86609950,4cyclictest7941-21ntpq20:25:172
86609950,3cyclictest1594-21cat22:50:002
86509955,0cyclictest743-21snmpd20:08:500
86509954,1cyclictest743-21snmpd20:53:370
86509954,1cyclictest743-21snmpd20:53:360
86509954,1cyclictest743-21snmpd20:00:410
86509954,1cyclictest22671-21needreboot23:40:170
86509954,1cyclictest15647-21ntpq19:25:180
86509953,0cyclictest0-21swapper/022:23:270
86509952,3cyclictest24515-21ntp_states22:25:170
86509952,2cyclictest9104-21sed23:05:220
86509952,2cyclictest575-21rs:main0
86509952,2cyclictest2504-21ld22:50:170
86509952,2cyclictest20742-21ls19:40:000
86509952,2cyclictest16652-21ld23:25:140
86509952,2cyclictest10528-21find21:50:200
86509950,4cyclictest6583-21ntpq23:00:170
86669942,2cyclictest17309-21smartctl19:30:133
86669942,2cyclictest15242-21tail19:25:153
86669941,2cyclictest27966-21cut21:15:153
86609943,1cyclictest9993-21df00:30:122
86609943,1cyclictest30017-21gltestperf22:40:122
86609941,2cyclictest557-21NetworkManager20:10:112
86609941,2cyclictest28491-21collect222:35:172
86609941,2cyclictest21738-21grep21:00:122
86609941,2cyclictest17830-21cut20:50:122
86609941,2cyclictest17830-21cut20:50:112
86609941,2cyclictest10424-21pluginstate21:50:182
86609940,3cyclictest12136-21fw_conntrack00:35:132
86509943,1cyclictest28119-21cat22:35:140
86509941,3cyclictest25327-21expr19:50:110
86509940,4cyclictest12278-21ntpq21:55:170
86509940,3cyclictest5435-21perl20:20:120
86509940,3cyclictest20366-21/usr/sbin/munin20:55:150
86509940,3cyclictest10003-21diskstats00:30:120
86669930,3cyclictest17954-21http23:30:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional