You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 10:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot7.osadl.org (updated Thu Dec 04, 2025 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11768993836,2cyclictest24255-21fwupd22:12:121
11771991918,1cyclictest60250irq/125-lan21:35:032
11771991918,1cyclictest60250irq/125-lan21:35:032
11771991918,1cyclictest60250irq/125-lan21:10:172
11771991817,1cyclictest60250irq/125-lan23:10:172
11771991717,0cyclictest60250irq/125-lan23:20:122
11771991717,0cyclictest60250irq/125-lan22:57:392
11771991717,0cyclictest60250irq/125-lan21:56:332
11771991717,0cyclictest60250irq/125-lan21:25:152
11771991717,0cyclictest60250irq/125-lan19:52:362
11771991717,0cyclictest60250irq/125-lan19:10:202
11771991716,1cyclictest60250irq/125-lan23:35:192
11771991716,1cyclictest60250irq/125-lan23:15:132
11771991716,1cyclictest60250irq/125-lan22:25:122
11771991716,1cyclictest60250irq/125-lan22:20:112
11771991716,1cyclictest60250irq/125-lan22:05:202
11771991716,1cyclictest60250irq/125-lan21:20:172
11771991716,1cyclictest60250irq/125-lan20:20:172
11771991716,1cyclictest60250irq/125-lan20:00:002
11771991716,1cyclictest60250irq/125-lan19:40:132
11771991616,0cyclictest60250irq/125-lan23:46:342
11771991616,0cyclictest60250irq/125-lan21:10:002
11771991616,0cyclictest60250irq/125-lan00:00:152
11771991615,1cyclictest60250irq/125-lan23:55:152
11771991615,1cyclictest60250irq/125-lan23:40:172
11771991615,1cyclictest60250irq/125-lan23:25:112
11771991615,1cyclictest60250irq/125-lan22:10:142
11771991615,1cyclictest60250irq/125-lan22:00:162
11771991615,1cyclictest60250irq/125-lan20:20:002
11771991615,1cyclictest60250irq/125-lan20:00:282
11771991615,1cyclictest60250irq/125-lan19:30:222
11771991615,1cyclictest60250irq/125-lan00:05:152
11771991515,0cyclictest60250irq/125-lan23:03:302
11771991515,0cyclictest60250irq/125-lan20:05:162
11771991515,0cyclictest60250irq/125-lan00:25:152
11771991514,1cyclictest60250irq/125-lan20:25:192
11771991514,1cyclictest60250irq/125-lan19:45:152
11771991514,1cyclictest60250irq/125-lan00:15:212
11768991515,0cyclictest329-21hwrng21:18:091
11768991515,0cyclictest329-21hwrng00:12:131
11768991515,0cyclictest329-21hwrng00:06:061
11771991413,1cyclictest60250irq/125-lan22:40:192
11771991413,1cyclictest60250irq/125-lan22:15:182
11771991413,1cyclictest60250irq/125-lan20:10:122
11771991412,1cyclictest60250irq/125-lan21:50:142
11768991414,0cyclictest329-21hwrng23:26:091
11768991414,0cyclictest329-21hwrng20:59:431
11768991414,0cyclictest329-21hwrng20:30:011
11768991414,0cyclictest329-21hwrng19:41:531
11771991313,0cyclictest60250irq/125-lan23:05:122
11771991313,0cyclictest60250irq/125-lan21:40:212
11771991312,1cyclictest60250irq/125-lan22:35:162
11771991312,1cyclictest60250irq/125-lan22:30:142
11771991312,1cyclictest60250irq/125-lan20:46:222
11771991312,1cyclictest60250irq/125-lan20:30:002
11771991312,1cyclictest60250irq/125-lan00:30:162
11768991313,0cyclictest329-21hwrng23:24:061
11768991313,0cyclictest329-21hwrng23:12:501
11768991313,0cyclictest329-21hwrng23:07:431
11768991313,0cyclictest329-21hwrng21:49:541
11768991313,0cyclictest329-21hwrng21:29:241
11768991313,0cyclictest329-21hwrng00:16:191
11768991313,0cyclictest329-21hwrng00:04:021
11771991211,1cyclictest60250irq/125-lan23:50:142
11771991211,1cyclictest60250irq/125-lan22:50:182
11771991211,1cyclictest60250irq/125-lan20:50:172
11771991211,1cyclictest60250irq/125-lan19:35:132
11771991211,1cyclictest60250irq/125-lan00:20:152
11768991212,0cyclictest329-21hwrng23:57:531
11768991212,0cyclictest329-21hwrng23:33:191
11768991212,0cyclictest329-21hwrng23:15:541
11768991212,0cyclictest329-21hwrng22:38:011
11768991212,0cyclictest329-21hwrng20:42:181
11768991212,0cyclictest329-21hwrng20:10:341
11775991111,0cyclictest329-21hwrng21:24:173
11771991111,0cyclictest60250irq/125-lan23:30:202
11771991111,0cyclictest329-21hwrng20:43:202
11771991110,1cyclictest60250irq/125-lan21:15:222
11771991110,1cyclictest60250irq/125-lan20:55:172
1177199109,1cyclictest60250irq/125-lan21:30:142
1177199109,1cyclictest60250irq/125-lan00:10:142
117719999,0cyclictest60250irq/125-lan20:36:132
117719999,0cyclictest60250irq/125-lan00:40:002
117719998,1cyclictest60250irq/125-lan21:45:222
117689999,0cyclictest329-21hwrng22:40:041
117689998,1cyclictest702-21snmpd21:50:461
117689997,2cyclictest702-21snmpd23:42:021
117689997,2cyclictest702-21snmpd20:00:121
117649998,1cyclictest702-21snmpd23:52:000
117649998,1cyclictest702-21snmpd20:45:430
117759988,0cyclictest702-21snmpd19:50:243
117759988,0cyclictest702-21snmpd00:36:313
117759988,0cyclictest329-21hwrng23:31:173
117759988,0cyclictest329-21hwrng21:17:073
117759988,0cyclictest329-21hwrng19:40:523
117759987,1cyclictest702-21snmpd21:06:113
117759987,1cyclictest702-21snmpd19:48:213
117759986,2cyclictest702-21snmpd22:02:403
117759986,2cyclictest702-21snmpd20:40:253
117719988,0cyclictest60250irq/125-lan21:00:172
117719988,0cyclictest60250irq/125-lan19:17:362
117719987,1cyclictest60250irq/125-lan22:45:142
117689988,0cyclictest702-21snmpd21:41:371
117689988,0cyclictest702-21snmpd20:20:281
117689987,1cyclictest702-21snmpd22:49:191
117689987,1cyclictest702-21snmpd20:51:231
117689984,3cyclictest702-21snmpd00:29:221
117649988,0cyclictest702-21snmpd22:02:160
117649988,0cyclictest329-21hwrng23:08:440
117649987,1cyclictest702-21snmpd19:13:170
117759977,0cyclictest702-21snmpd22:44:123
117759977,0cyclictest702-21snmpd22:11:143
117759977,0cyclictest702-21snmpd21:37:513
117759977,0cyclictest702-21snmpd21:37:513
117759977,0cyclictest702-21snmpd20:55:203
117759977,0cyclictest702-21snmpd20:49:253
117759977,0cyclictest702-21snmpd00:02:013
117759977,0cyclictest329-21hwrng21:50:553
117759977,0cyclictest329-21hwrng19:23:273
117759977,0cyclictest329-21hwrng19:16:173
117759976,1cyclictest702-21snmpd22:52:123
117759976,1cyclictest702-21snmpd22:18:233
117759976,1cyclictest702-21snmpd21:58:163
117759976,1cyclictest702-21snmpd20:11:063
117759976,1cyclictest702-21snmpd20:04:483
117759976,1cyclictest702-21snmpd19:56:573
117759976,1cyclictest702-21snmpd00:30:353
117759976,1cyclictest702-21snmpd00:26:373
117719977,0cyclictest60250irq/125-lan19:25:012
117719976,1cyclictest60250irq/125-lan19:20:162
117689977,0cyclictest702-21snmpd22:08:141
117689977,0cyclictest702-21snmpd21:30:181
117689977,0cyclictest702-21snmpd21:24:361
117689977,0cyclictest702-21snmpd19:20:591
117689976,1cyclictest7470-21cat22:50:141
117689976,1cyclictest702-21snmpd22:24:111
117689976,1cyclictest702-21snmpd21:04:201
117689976,1cyclictest329-21hwrng23:03:371
117689975,2cyclictest702-21snmpd19:52:001
117689975,2cyclictest702-21snmpd19:16:501
117689973,4cyclictest4519-21munin-plugin-st20:10:001
117689973,3cyclictest702-21snmpd23:48:291
117689971,2cyclictest19291-21ntpq19:25:151
117649977,0cyclictest702-21snmpd23:55:540
117649977,0cyclictest702-21snmpd23:37:510
117649977,0cyclictest702-21snmpd23:22:470
117649977,0cyclictest702-21snmpd23:13:370
117649977,0cyclictest702-21snmpd23:01:390
117649977,0cyclictest702-21snmpd21:59:400
117649977,0cyclictest329-21hwrng23:15:540
117649977,0cyclictest329-21hwrng22:41:050
117649977,0cyclictest329-21hwrng21:12:000
117649977,0cyclictest329-21hwrng20:33:050
117649977,0cyclictest329-21hwrng00:00:570
117649976,1cyclictest9758-21cat20:20:170
117649976,1cyclictest702-21snmpd22:13:110
117649976,1cyclictest702-21snmpd22:06:310
117649976,1cyclictest702-21snmpd21:54:460
117759966,0cyclictest702-21snmpd22:56:093
117759966,0cyclictest702-21snmpd22:39:153
117759966,0cyclictest702-21snmpd22:22:353
117759966,0cyclictest702-21snmpd21:45:133
117759966,0cyclictest329-21hwrng21:25:193
117759966,0cyclictest329-21hwrng21:10:593
117759966,0cyclictest329-21hwrng21:01:463
117759966,0cyclictest329-21hwrng20:50:303
117759966,0cyclictest329-21hwrng20:05:263
117759966,0cyclictest329-21hwrng19:36:463
117759966,0cyclictest329-21hwrng19:30:383
117759966,0cyclictest329-21hwrng19:10:093
117759965,1cyclictest702-21snmpd23:15:173
117759965,1cyclictest702-21snmpd22:31:533
117759965,1cyclictest702-21snmpd20:25:013
117759965,1cyclictest702-21snmpd20:19:503
117759965,1cyclictest702-21snmpd00:19:313
117759965,1cyclictest16241-21cat20:35:153
117689966,0cyclictest702-21snmpd21:13:231
117689965,1cyclictest702-21snmpd00:36:171
117689964,2cyclictest31947-21ntpq19:55:181
117689963,3cyclictest702-21snmpd19:35:021
117689961,2cyclictest18488-21date22:00:001
117689961,1cyclictest13066-21sort19:10:201
117689961,1cyclictest0-21swapper/100:35:001
117689960,5cyclictest0-21swapper/119:50:001
117689960,2cyclictest9843-21ld22:55:171
117689960,2cyclictest9316-21ntpq21:35:191
117689960,2cyclictest9316-21ntpq21:35:181
117689960,2cyclictest31635-21grep23:50:141
117689960,2cyclictest30118-21ntp_states22:25:181
117689960,2cyclictest29618-21ntpq21:05:171
117689960,2cyclictest25900-21grep23:35:171
117689960,2cyclictest21281-21ntpq19:30:161
117689960,1cyclictest0-21swapper/122:00:131
117649966,0cyclictest702-21snmpd22:54:150
117649966,0cyclictest329-21hwrng23:42:320
117649966,0cyclictest329-21hwrng22:36:590
117649966,0cyclictest329-21hwrng22:27:470
117649966,0cyclictest329-21hwrng21:42:430
117649966,0cyclictest329-21hwrng21:22:150
117649966,0cyclictest329-21hwrng21:08:570
117649966,0cyclictest329-21hwrng20:13:380
117649966,0cyclictest329-21hwrng20:02:220
117649966,0cyclictest329-21hwrng19:48:020
117649966,0cyclictest329-21hwrng00:26:330
117649966,0cyclictest329-21hwrng00:21:270
117649965,1cyclictest702-21snmpd19:54:270
117649965,1cyclictest5437-21cat22:45:130
117759955,0cyclictest702-21snmpd00:11:063
117759955,0cyclictest329-21hwrng23:00:343
117759955,0cyclictest329-21hwrng22:45:113
117759955,0cyclictest329-21hwrng21:40:403
117759955,0cyclictest329-21hwrng21:30:263
117759955,0cyclictest329-21hwrng19:28:353
117759954,1cyclictest702-21snmpd23:59:513
117759953,2cyclictest14228-21cat20:30:153
117689954,1cyclictest702-21snmpd20:35:041
117689951,1cyclictest0-21swapper/122:15:161
117689950,2cyclictest7374-21/usr/sbin/munin20:15:141
117689950,2cyclictest20433-21df20:45:111
117689950,2cyclictest11930-21ntpq00:20:181
117689950,2cyclictest11320-21/usr/sbin/munin20:25:101
117689950,1cyclictest31288-21apt-get22:30:131
117649955,0cyclictest702-21snmpd22:19:320
117649955,0cyclictest702-21snmpd20:18:310
117649955,0cyclictest702-21snmpd19:25:020
117649955,0cyclictest329-21hwrng23:45:360
117649955,0cyclictest329-21hwrng22:24:420
117649955,0cyclictest329-21hwrng21:36:360
117649955,0cyclictest329-21hwrng21:36:350
117649955,0cyclictest329-21hwrng20:53:340
117649955,0cyclictest329-21hwrng20:05:260
117649955,0cyclictest329-21hwrng19:56:140
117649955,0cyclictest329-21hwrng19:44:580
117649955,0cyclictest329-21hwrng00:34:450
117649955,0cyclictest329-21hwrng00:19:230
117649954,1cyclictest702-21snmpd00:11:420
117649954,1cyclictest22945-21turbostat23:30:000
117649953,2cyclictest6546-21apt-get21:30:120
117759944,0cyclictest329-21hwrng20:20:483
117759943,1cyclictest702-21snmpd23:29:023
117759943,1cyclictest702-21snmpd00:06:483
117759942,2cyclictest702-21snmpd23:10:313
117759942,2cyclictest25531-21perl23:35:153
117649944,0cyclictest702-21snmpd20:40:460
117649944,0cyclictest329-21hwrng21:45:480
117649944,0cyclictest329-21hwrng21:26:200
117649944,0cyclictest329-21hwrng21:00:440
117649944,0cyclictest329-21hwrng00:36:490
117649944,0cyclictest329-21hwrng00:07:070
117649943,1cyclictest702-21snmpd19:15:260
117649943,1cyclictest31720-21cat22:30:140
117649942,2cyclictest702-21snmpd21:16:590
117649942,2cyclictest702-21snmpd19:24:140
117649942,2cyclictest22931-21sed19:35:140
117649941,2cyclictest151ktimers/020:25:100
117649940,4cyclictest22298-21turbostat19:35:000
117649940,4cyclictest0-21swapper/021:00:000
117759932,1cyclictest702-21snmpd23:42:113
117759932,1cyclictest431ktimers/322:05:263
117759932,1cyclictest31470-21df23:50:123
117759932,1cyclictest0-21swapper/322:25:183
117759931,2cyclictest11846-21netstat00:20:163
117759930,3cyclictest19571-21hddtemp_smartct23:20:153
117759930,3cyclictest0-21swapper/323:45:173
117649932,1cyclictest9206-21sh22:55:120
117649932,1cyclictest702-21snmpd20:35:100
117649931,2cyclictest23410-21expr23:30:110
117759920,1cyclictest13119-21apt-get23:05:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional