You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 19:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot7.osadl.org (updated Tue Dec 02, 2025 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12539991918,1cyclictest60250irq/125-lan10:35:002
12539991818,0cyclictest60250irq/125-lan11:15:192
12539991818,0cyclictest60250irq/125-lan10:02:102
12539991817,1cyclictest60250irq/125-lan12:00:182
12539991817,1cyclictest60250irq/125-lan11:10:192
12539991817,1cyclictest60250irq/125-lan11:00:182
12539991817,1cyclictest60250irq/125-lan10:45:162
12539991817,1cyclictest60250irq/125-lan10:15:222
12539991817,1cyclictest60250irq/125-lan09:35:182
12539991817,1cyclictest60250irq/125-lan08:55:212
12539991717,0cyclictest60250irq/125-lan11:53:252
12539991717,0cyclictest60250irq/125-lan11:24:552
12539991717,0cyclictest60250irq/125-lan09:15:172
12539991717,0cyclictest60250irq/125-lan08:00:202
12539991716,1cyclictest60250irq/125-lan12:10:542
12539991716,1cyclictest60250irq/125-lan12:10:542
12539991716,1cyclictest60250irq/125-lan11:40:182
12539991716,1cyclictest60250irq/125-lan10:55:182
12539991716,1cyclictest60250irq/125-lan10:50:142
12539991716,1cyclictest60250irq/125-lan09:45:172
12539991716,1cyclictest60250irq/125-lan09:10:002
12539991716,1cyclictest60250irq/125-lan08:05:162
12539991616,0cyclictest60250irq/125-lan09:25:202
12539991616,0cyclictest60250irq/125-lan08:45:142
12539991616,0cyclictest60250irq/125-lan08:20:122
12539991615,1cyclictest60250irq/125-lan11:30:112
12539991615,1cyclictest60250irq/125-lan07:20:212
12543991515,0cyclictest329-21hwrng07:37:093
12539991515,0cyclictest60250irq/125-lan12:30:182
12539991515,0cyclictest60250irq/125-lan12:16:192
12539991515,0cyclictest60250irq/125-lan09:40:132
12539991515,0cyclictest60250irq/125-lan07:41:192
12539991515,0cyclictest60250irq/125-lan07:35:202
12539991514,1cyclictest60250irq/125-lan12:35:272
12539991514,1cyclictest60250irq/125-lan12:25:212
12539991514,1cyclictest60250irq/125-lan12:20:192
12539991514,1cyclictest60250irq/125-lan11:35:232
12539991514,1cyclictest60250irq/125-lan11:05:162
12539991514,1cyclictest60250irq/125-lan10:20:212
12539991514,1cyclictest60250irq/125-lan08:50:172
12539991514,1cyclictest60250irq/125-lan08:25:162
12539991514,1cyclictest60250irq/125-lan07:50:092
12539991414,0cyclictest60250irq/125-lan10:40:192
12539991414,0cyclictest60250irq/125-lan10:05:192
12539991414,0cyclictest60250irq/125-lan09:20:132
12539991414,0cyclictest60250irq/125-lan07:25:142
12539991414,0cyclictest329-21hwrng10:14:512
12539991413,1cyclictest60250irq/125-lan09:10:172
12539991313,0cyclictest60250irq/125-lan11:59:192
12539991313,0cyclictest60250irq/125-lan11:25:112
12539991313,0cyclictest60250irq/125-lan10:35:242
12539991313,0cyclictest60250irq/125-lan09:00:142
12539991313,0cyclictest329-21hwrng08:17:052
12539991313,0cyclictest329-21hwrng07:18:432
12539991312,1cyclictest60250irq/125-lan07:30:152
12539991212,0cyclictest60250irq/125-lan07:10:112
12539991212,0cyclictest329-21hwrng09:57:262
12539991211,1cyclictest60250irq/125-lan09:30:172
12539991211,1cyclictest60250irq/125-lan08:40:172
12539991211,1cyclictest60250irq/125-lan07:55:192
12539991111,0cyclictest60250irq/125-lan09:50:112
12539991110,1cyclictest60250irq/125-lan12:05:192
12539991110,1cyclictest60250irq/125-lan08:35:232
12535991111,0cyclictest329-21hwrng10:50:421
12535991111,0cyclictest329-21hwrng10:16:541
12535991111,0cyclictest329-21hwrng08:25:171
1253999109,1cyclictest60250irq/125-lan08:30:142
12539991010,0cyclictest60250irq/125-lan10:28:032
12539991010,0cyclictest60250irq/125-lan08:12:022
12535991010,0cyclictest329-21hwrng07:18:431
12529991010,0cyclictest329-21hwrng11:12:110
125399998,1cyclictest60250irq/125-lan11:45:152
125359999,0cyclictest329-21hwrng10:59:541
125359999,0cyclictest329-21hwrng07:40:141
125439988,0cyclictest702-21snmpd08:22:523
125439988,0cyclictest329-21hwrng12:34:083
125439988,0cyclictest329-21hwrng11:47:003
125439988,0cyclictest329-21hwrng11:40:523
125439988,0cyclictest329-21hwrng11:39:513
125439988,0cyclictest329-21hwrng10:53:463
125439988,0cyclictest329-21hwrng10:00:323
125439988,0cyclictest329-21hwrng09:45:103
125439988,0cyclictest329-21hwrng08:46:473
125439988,0cyclictest329-21hwrng08:44:443
125439988,0cyclictest329-21hwrng08:02:453
125439988,0cyclictest329-21hwrng07:59:413
125439988,0cyclictest329-21hwrng07:53:323
125439988,0cyclictest329-21hwrng07:44:193
125439988,0cyclictest329-21hwrng07:34:053
125439988,0cyclictest329-21hwrng07:24:523
125439987,1cyclictest702-21snmpd12:38:363
125439987,1cyclictest702-21snmpd11:14:133
125439986,1cyclictest702-21snmpd10:45:393
125359988,0cyclictest702-21snmpd10:32:111
125359988,0cyclictest702-21snmpd09:05:291
125359988,0cyclictest702-21snmpd08:08:451
125359988,0cyclictest329-21hwrng12:26:561
125359988,0cyclictest329-21hwrng12:05:261
125359988,0cyclictest329-21hwrng10:28:101
125359988,0cyclictest329-21hwrng09:57:261
125359988,0cyclictest329-21hwrng07:33:031
125359988,0cyclictest329-21hwrng07:29:591
125359987,1cyclictest702-21snmpd11:14:251
125359987,1cyclictest702-21snmpd08:57:411
125299988,0cyclictest702-21snmpd12:38:400
125299988,0cyclictest702-21snmpd12:15:180
125299988,0cyclictest702-21snmpd12:12:280
125299988,0cyclictest702-21snmpd12:12:270
125299988,0cyclictest702-21snmpd11:45:530
125299988,0cyclictest702-21snmpd11:39:470
125299988,0cyclictest702-21snmpd09:25:090
125299988,0cyclictest702-21snmpd08:25:520
125299988,0cyclictest702-21snmpd08:24:160
125299988,0cyclictest702-21snmpd07:43:420
125299988,0cyclictest702-21snmpd07:13:520
125299988,0cyclictest329-21hwrng12:08:310
125299988,0cyclictest329-21hwrng12:04:250
125299988,0cyclictest329-21hwrng11:57:160
125299988,0cyclictest329-21hwrng10:36:220
125299988,0cyclictest329-21hwrng08:32:270
125299988,0cyclictest329-21hwrng08:14:010
125299988,0cyclictest329-21hwrng07:54:340
125299988,0cyclictest329-21hwrng07:28:580
125299987,1cyclictest702-21snmpd08:08:210
125439977,0cyclictest702-21snmpd11:59:053
125439977,0cyclictest702-21snmpd10:43:423
125439977,0cyclictest702-21snmpd10:39:393
125439977,0cyclictest702-21snmpd09:43:433
125439977,0cyclictest702-21snmpd09:32:553
125439977,0cyclictest702-21snmpd09:22:543
125439977,0cyclictest702-21snmpd09:04:473
125439977,0cyclictest702-21snmpd08:14:063
125439977,0cyclictest329-21hwrng12:04:253
125439977,0cyclictest329-21hwrng11:50:063
125439977,0cyclictest329-21hwrng11:05:013
125439977,0cyclictest329-21hwrng11:04:003
125439977,0cyclictest329-21hwrng10:55:483
125439977,0cyclictest329-21hwrng10:24:043
125439977,0cyclictest329-21hwrng10:19:583
125439977,0cyclictest329-21hwrng10:10:453
125439977,0cyclictest329-21hwrng09:25:423
125439977,0cyclictest329-21hwrng08:50:533
125439977,0cyclictest329-21hwrng07:49:263
125439976,1cyclictest702-21snmpd12:13:273
125439976,1cyclictest702-21snmpd12:13:273
125439976,1cyclictest702-21snmpd11:31:163
125439976,1cyclictest702-21snmpd11:25:433
125439975,2cyclictest12293-21cat12:20:153
125399977,0cyclictest60250irq/125-lan07:45:202
125359977,0cyclictest702-21snmpd10:05:371
125359977,0cyclictest702-21snmpd09:47:041
125359977,0cyclictest702-21snmpd09:18:331
125359977,0cyclictest329-21hwrng12:31:021
125359977,0cyclictest329-21hwrng11:44:571
125359977,0cyclictest329-21hwrng11:06:041
125359977,0cyclictest329-21hwrng10:45:341
125359977,0cyclictest329-21hwrng10:42:301
125359977,0cyclictest329-21hwrng09:20:351
125359977,0cyclictest329-21hwrng08:38:361
125359977,0cyclictest329-21hwrng07:21:481
125359976,1cyclictest702-21snmpd11:27:101
125359976,1cyclictest702-21snmpd11:22:561
125359976,1cyclictest702-21snmpd09:54:551
125359975,2cyclictest702-21snmpd12:24:101
125299977,0cyclictest702-21snmpd10:20:330
125299977,0cyclictest702-21snmpd09:34:420
125299977,0cyclictest702-21snmpd08:40:250
125299977,0cyclictest702-21snmpd07:20:050
125299977,0cyclictest329-21hwrng12:22:520
125299977,0cyclictest329-21hwrng11:25:300
125299977,0cyclictest329-21hwrng11:23:270
125299977,0cyclictest329-21hwrng11:17:190
125299977,0cyclictest329-21hwrng11:09:070
125299977,0cyclictest329-21hwrng10:33:170
125299977,0cyclictest329-21hwrng09:50:160
125299977,0cyclictest329-21hwrng09:06:140
125299977,0cyclictest329-21hwrng08:35:310
125299977,0cyclictest329-21hwrng08:18:070
125299977,0cyclictest329-21hwrng07:56:370
125299976,1cyclictest702-21snmpd11:02:300
125299976,1cyclictest702-21snmpd10:59:210
125299976,1cyclictest702-21snmpd10:49:060
125299976,1cyclictest702-21snmpd10:13:350
125299976,1cyclictest16310-21cat12:30:140
125299975,2cyclictest702-21snmpd07:30:350
125299975,1cyclictest702-21snmpd11:30:160
125299975,1cyclictest702-21snmpd10:02:010
125439966,0cyclictest702-21snmpd10:31:323
125439966,0cyclictest702-21snmpd09:50:163
125439966,0cyclictest702-21snmpd09:38:483
125439966,0cyclictest329-21hwrng08:07:523
125439966,0cyclictest329-21hwrng07:28:583
125439965,1cyclictest702-21snmpd10:08:463
125439965,1cyclictest702-21snmpd08:38:583
125359966,0cyclictest702-21snmpd12:19:271
125359966,0cyclictest702-21snmpd10:11:351
125359966,0cyclictest702-21snmpd09:12:591
125359966,0cyclictest702-21snmpd08:22:401
125359966,0cyclictest702-21snmpd08:15:451
125359966,0cyclictest329-21hwrng12:39:151
125359966,0cyclictest329-21hwrng11:55:121
125359966,0cyclictest329-21hwrng11:50:051
125359966,0cyclictest329-21hwrng11:02:581
125359966,0cyclictest329-21hwrng10:22:021
125359966,0cyclictest329-21hwrng09:32:521
125359966,0cyclictest329-21hwrng07:35:061
125359965,1cyclictest702-21snmpd08:10:451
125359965,1cyclictest702-21snmpd07:50:571
125299966,0cyclictest702-21snmpd09:55:460
125299966,0cyclictest702-21snmpd09:03:440
125299966,0cyclictest702-21snmpd08:55:290
125299966,0cyclictest702-21snmpd08:47:380
125299966,0cyclictest329-21hwrng09:15:270
125299966,0cyclictest329-21hwrng07:15:380
125299965,1cyclictest702-21snmpd11:53:200
125299965,1cyclictest702-21snmpd10:26:410
125299965,1cyclictest702-21snmpd08:03:390
125299965,1cyclictest27655-21cpuspeed_turbos11:40:150
125439955,0cyclictest702-21snmpd12:09:123
125439955,0cyclictest702-21snmpd07:14:443
125439954,1cyclictest17048-21cat09:55:133
125359955,0cyclictest702-21snmpd08:41:311
125359955,0cyclictest329-21hwrng11:45:591
125359955,0cyclictest329-21hwrng07:45:211
125359954,1cyclictest702-21snmpd09:28:241
125359952,1cyclictest14472-21idleruntime-cro07:15:001
125299955,0cyclictest702-21snmpd10:06:080
125299955,0cyclictest702-21snmpd09:23:090
125299955,0cyclictest329-21hwrng09:10:200
125299954,1cyclictest702-21snmpd10:19:290
125439944,0cyclictest702-21snmpd08:25:253
125439944,0cyclictest329-21hwrng10:25:053
125439944,0cyclictest329-21hwrng09:10:203
125439943,1cyclictest702-21snmpd11:22:083
125439943,1cyclictest702-21snmpd08:16:063
125439943,1cyclictest28577-21ntpq09:05:163
125439942,2cyclictest24602-21nvmesmart_nvme008:55:203
125359944,0cyclictest702-21snmpd12:01:501
125359944,0cyclictest702-21snmpd08:04:011
125359944,0cyclictest329-21hwrng12:14:401
125359944,0cyclictest329-21hwrng12:14:391
125359944,0cyclictest329-21hwrng11:16:171
125359944,0cyclictest329-21hwrng10:39:261
125359944,0cyclictest329-21hwrng08:30:241
125359944,0cyclictest10773-21grep09:40:151
125359943,1cyclictest702-21snmpd09:01:591
125359942,2cyclictest21443-21dump-pmu-power08:50:001
125359942,2cyclictest19249-21needreboot10:00:151
125299944,0cyclictest702-21snmpd10:43:180
125299944,0cyclictest329-21hwrng07:46:220
125299943,1cyclictest702-21snmpd07:39:020
125299943,1cyclictest14714-21ntp_states12:25:180
125299943,1cyclictest12948-21cut09:45:140
125299942,2cyclictest702-21snmpd10:54:130
125299942,2cyclictest702-21snmpd09:44:190
125439932,1cyclictest32196-21tr09:15:153
125439931,2cyclictest15095-21seq08:31:213
125439930,3cyclictest17831-21head11:15:143
125439930,3cyclictest14263-21hddtemp_smartct12:25:143
125439930,3cyclictest10079-21ntpq12:15:203
125359932,1cyclictest271ktimers/107:56:521
125359932,1cyclictest25534-21apt11:35:121
125359931,2cyclictest8896-21ntpq09:35:181
125359931,2cyclictest23510-21apt11:30:111
125359930,3cyclictest22489-21ntpq08:50:171
125299932,1cyclictest702-21snmpd08:51:110
125299931,2cyclictest702-21snmpd09:38:030
125439921,1cyclictest702-21snmpd07:15:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional