You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-03-18 - 04:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot7.osadl.org (updated Tue Mar 18, 2025 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28345991918,1cyclictest60250irq/125-lan23:36:162
28345991918,1cyclictest60250irq/125-lan23:10:152
28345991918,1cyclictest60250irq/125-lan23:07:202
28345991918,1cyclictest60250irq/125-lan21:53:222
28345991818,0cyclictest60250irq/125-lan22:48:512
28345991818,0cyclictest60250irq/125-lan22:04:412
28345991817,1cyclictest60250irq/125-lan23:55:092
28345991817,1cyclictest60250irq/125-lan23:46:482
28345991817,1cyclictest60250irq/125-lan23:20:122
28345991817,1cyclictest60250irq/125-lan22:50:372
28345991817,1cyclictest60250irq/125-lan22:20:152
28345991817,1cyclictest60250irq/125-lan22:19:032
28345991817,1cyclictest60250irq/125-lan21:22:302
28345991817,1cyclictest60250irq/125-lan21:14:462
28345991817,1cyclictest60250irq/125-lan20:55:162
28345991817,1cyclictest60250irq/125-lan00:30:122
28345991817,1cyclictest60250irq/125-lan00:15:352
28345991816,1cyclictest60250irq/125-lan00:36:172
28345991717,0cyclictest60250irq/125-lan21:25:552
28345991716,1cyclictest60250irq/125-lan23:50:552
28345991716,1cyclictest60250irq/125-lan23:43:232
28345991716,1cyclictest60250irq/125-lan23:30:512
28345991716,1cyclictest60250irq/125-lan23:15:462
28345991716,1cyclictest60250irq/125-lan23:02:442
28345991716,1cyclictest60250irq/125-lan22:56:412
28345991716,1cyclictest60250irq/125-lan22:40:222
28345991716,1cyclictest60250irq/125-lan22:36:372
28345991716,1cyclictest60250irq/125-lan22:25:162
28345991716,1cyclictest60250irq/125-lan22:05:162
28345991716,1cyclictest60250irq/125-lan21:59:032
28345991716,1cyclictest60250irq/125-lan21:35:292
28345991716,1cyclictest60250irq/125-lan21:19:412
28345991716,1cyclictest60250irq/125-lan19:30:152
28345991716,1cyclictest60250irq/125-lan00:05:352
28345991716,1cyclictest60250irq/125-lan00:02:552
28345991715,1cyclictest60250irq/125-lan22:14:042
28345991715,1cyclictest60250irq/125-lan21:30:332
28345991616,0cyclictest60250irq/125-lan21:42:372
28345991616,0cyclictest60250irq/125-lan19:37:292
28345991616,0cyclictest60250irq/125-lan19:27:532
28345991616,0cyclictest60250irq/125-lan00:21:462
28345991615,1cyclictest60250irq/125-lan23:27:442
28345991615,1cyclictest60250irq/125-lan22:31:252
28345991615,1cyclictest60250irq/125-lan21:45:032
28345991615,1cyclictest60250irq/125-lan20:50:142
28345991615,1cyclictest60250irq/125-lan20:30:172
28345991615,1cyclictest60250irq/125-lan20:20:152
28345991615,1cyclictest60250irq/125-lan19:55:202
28345991615,1cyclictest60250irq/125-lan00:11:282
28345991515,0cyclictest329-21hwrng00:25:112
28345991514,1cyclictest60250irq/125-lan21:00:172
28345991514,1cyclictest60250irq/125-lan20:45:182
28345991514,1cyclictest60250irq/125-lan20:15:182
28345991514,1cyclictest60250irq/125-lan20:00:102
28345991413,1cyclictest60250irq/125-lan20:44:582
28345991413,1cyclictest60250irq/125-lan20:10:222
28345991413,1cyclictest60250irq/125-lan20:05:202
28345991413,1cyclictest60250irq/125-lan19:15:202
28345991313,0cyclictest60250irq/125-lan21:06:532
28345991312,1cyclictest60250irq/125-lan19:50:132
28345991312,1cyclictest60250irq/125-lan19:10:132
28345991212,0cyclictest60250irq/125-lan19:45:522
28335991212,0cyclictest329-21hwrng20:15:200
28345991110,1cyclictest60250irq/125-lan20:25:162
28345991110,1cyclictest60250irq/125-lan19:40:172
28337991111,0cyclictest329-21hwrng20:19:241
28349991010,0cyclictest329-21hwrng23:51:233
28337991010,0cyclictest329-21hwrng21:56:421
283499999,0cyclictest329-21hwrng20:15:203
283499999,0cyclictest329-21hwrng00:25:113
283459998,1cyclictest60250irq/125-lan19:20:172
283379998,1cyclictest702-21snmpd23:42:471
283499988,0cyclictest702-21snmpd22:33:263
283499988,0cyclictest702-21snmpd22:07:553
283499988,0cyclictest702-21snmpd21:18:233
283499988,0cyclictest702-21snmpd19:50:283
283499988,0cyclictest702-21snmpd19:25:273
283499988,0cyclictest702-21snmpd00:23:183
283499988,0cyclictest329-21hwrng23:59:353
283499988,0cyclictest329-21hwrng23:38:043
283499988,0cyclictest329-21hwrng23:14:313
283499988,0cyclictest329-21hwrng22:52:003
283499988,0cyclictest329-21hwrng22:39:423
283499988,0cyclictest329-21hwrng22:16:093
283499988,0cyclictest329-21hwrng20:47:043
283499987,1cyclictest702-21snmpd23:15:523
283499987,1cyclictest702-21snmpd20:22:203
283499987,1cyclictest27850-21kworker/3:1+events22:48:553
283379988,0cyclictest702-21snmpd22:02:011
283379988,0cyclictest702-21snmpd20:14:131
283379988,0cyclictest702-21snmpd20:01:451
283379988,0cyclictest702-21snmpd00:29:071
283379988,0cyclictest702-21snmpd00:24:421
283379988,0cyclictest329-21hwrng21:05:301
283359988,0cyclictest702-21snmpd22:03:100
283359988,0cyclictest702-21snmpd21:29:450
283359988,0cyclictest702-21snmpd19:19:120
283359988,0cyclictest329-21hwrng23:07:210
283359988,0cyclictest329-21hwrng22:53:010
283359988,0cyclictest329-21hwrng21:47:290
283359988,0cyclictest329-21hwrng20:32:440
283359987,1cyclictest702-21snmpd19:38:300
283499977,0cyclictest702-21snmpd23:46:143
283499977,0cyclictest702-21snmpd21:30:443
283499977,0cyclictest702-21snmpd21:11:183
283499977,0cyclictest702-21snmpd21:00:203
283499977,0cyclictest702-21snmpd19:31:333
283499977,0cyclictest702-21snmpd19:16:183
283499977,0cyclictest329-21hwrng23:23:443
283499977,0cyclictest329-21hwrng23:06:203
283499977,0cyclictest329-21hwrng23:01:133
283499977,0cyclictest329-21hwrng21:55:413
283499977,0cyclictest329-21hwrng21:36:133
283499977,0cyclictest329-21hwrng20:55:163
283499977,0cyclictest329-21hwrng20:26:353
283499977,0cyclictest329-21hwrng20:02:013
283499977,0cyclictest329-21hwrng19:57:553
283499977,0cyclictest329-21hwrng00:12:533
283499977,0cyclictest329-21hwrng00:01:383
283499976,1cyclictest702-21snmpd22:55:123
283499976,1cyclictest702-21snmpd20:39:503
283499976,1cyclictest27850-21kworker/3:1+events00:31:193
283499976,1cyclictest27850-21kworker/3:1+events00:05:433
283379977,0cyclictest702-21snmpd23:39:581
283379977,0cyclictest702-21snmpd23:33:461
283379977,0cyclictest702-21snmpd22:40:111
283379977,0cyclictest702-21snmpd22:35:311
283379977,0cyclictest702-21snmpd22:18:021
283379977,0cyclictest702-21snmpd21:50:401
283379977,0cyclictest702-21snmpd20:08:131
283379976,1cyclictest702-21snmpd22:54:001
283379976,1cyclictest702-21snmpd21:28:301
283379976,1cyclictest6552-21cat21:00:191
283359977,0cyclictest702-21snmpd23:53:470
283359977,0cyclictest702-21snmpd23:49:080
283359977,0cyclictest702-21snmpd22:32:530
283359977,0cyclictest702-21snmpd21:11:090
283359977,0cyclictest702-21snmpd20:42:290
283359977,0cyclictest702-21snmpd19:55:040
283359977,0cyclictest329-21hwrng22:23:190
283359977,0cyclictest329-21hwrng21:40:190
283359977,0cyclictest329-21hwrng21:20:520
283359977,0cyclictest329-21hwrng21:18:490
283359977,0cyclictest329-21hwrng21:07:330
283359977,0cyclictest329-21hwrng20:35:480
283359977,0cyclictest329-21hwrng20:20:270
283359977,0cyclictest329-21hwrng20:14:180
283359977,0cyclictest329-21hwrng19:50:450
283359977,0cyclictest329-21hwrng00:34:240
283359976,1cyclictest702-21snmpd19:27:000
283359976,1cyclictest702-21snmpd19:12:540
283359976,1cyclictest702-21snmpd00:02:140
283499966,0cyclictest702-21snmpd21:43:253
283499966,0cyclictest702-21snmpd19:37:243
283499966,0cyclictest329-21hwrng22:20:153
283499966,0cyclictest329-21hwrng20:06:073
283499965,1cyclictest702-21snmpd22:25:083
283499965,1cyclictest702-21snmpd22:12:193
283499965,1cyclictest702-21snmpd21:51:523
283499965,1cyclictest702-21snmpd21:49:223
283499965,1cyclictest702-21snmpd00:39:333
283379966,0cyclictest702-21snmpd23:56:591
283379966,0cyclictest702-21snmpd23:06:301
283379966,0cyclictest702-21snmpd22:29:591
283379966,0cyclictest702-21snmpd22:08:521
283379966,0cyclictest702-21snmpd21:42:101
283379966,0cyclictest702-21snmpd21:15:121
283379966,0cyclictest702-21snmpd19:15:261
283379966,0cyclictest329-21hwrng23:17:361
283379966,0cyclictest329-21hwrng19:39:291
283379965,1cyclictest702-21snmpd22:49:211
283379965,1cyclictest702-21snmpd22:34:441
283379965,1cyclictest702-21snmpd22:14:501
283379965,1cyclictest702-21snmpd19:45:241
283379965,1cyclictest702-21snmpd19:34:381
283379964,2cyclictest702-21snmpd21:23:391
283359966,0cyclictest702-21snmpd23:56:030
283359966,0cyclictest702-21snmpd23:01:150
283359966,0cyclictest702-21snmpd21:57:460
283359966,0cyclictest702-21snmpd00:27:210
283359966,0cyclictest329-21hwrng23:25:470
283359966,0cyclictest329-21hwrng23:15:330
283359966,0cyclictest329-21hwrng22:45:510
283359966,0cyclictest329-21hwrng22:42:470
283359966,0cyclictest329-21hwrng22:37:400
283359966,0cyclictest329-21hwrng00:05:430
283359965,1cyclictest21142-21cat23:10:100
283359964,2cyclictest702-21snmpd23:38:220
283359964,2cyclictest702-21snmpd00:24:240
283499955,0cyclictest702-21snmpd21:05:303
283499955,0cyclictest702-21snmpd20:41:563
283499955,0cyclictest702-21snmpd19:49:583
283499955,0cyclictest329-21hwrng20:31:423
283499955,0cyclictest329-21hwrng20:10:123
283379955,0cyclictest702-21snmpd22:20:081
283379955,0cyclictest702-21snmpd19:51:551
283379954,1cyclictest702-21snmpd23:10:061
283379954,1cyclictest702-21snmpd19:11:121
283379954,1cyclictest702-21snmpd00:38:331
283379953,2cyclictest4927-21ntpq20:55:201
283379950,2cyclictest2973350ssh21:32:071
283359955,0cyclictest702-21snmpd22:12:130
283359955,0cyclictest702-21snmpd21:34:310
283359955,0cyclictest702-21snmpd19:44:490
283359955,0cyclictest702-21snmpd19:22:060
283359955,0cyclictest702-21snmpd00:15:180
283359955,0cyclictest329-21hwrng23:24:460
283359955,0cyclictest329-21hwrng21:51:340
283359955,0cyclictest329-21hwrng21:00:230
283359955,0cyclictest329-21hwrng20:55:160
283359955,0cyclictest329-21hwrng00:37:280
283359954,1cyclictest702-21snmpd20:53:180
283359954,1cyclictest702-21snmpd20:00:430
283359950,5cyclictest8714-21turbostat22:20:000
283499944,0cyclictest329-21hwrng23:41:093
283499943,1cyclictest431ktimers/322:40:333
283499942,2cyclictest702-21snmpd22:01:043
283499942,2cyclictest516-21awk19:20:143
283499942,2cyclictest17526-21cat00:15:203
283459944,0cyclictest60250irq/125-lan20:35:532
283379944,0cyclictest700-21lldpd21:11:441
283379944,0cyclictest329-21hwrng23:45:151
283379944,0cyclictest329-21hwrng21:46:281
283379944,0cyclictest329-21hwrng20:35:481
283379944,0cyclictest329-21hwrng19:42:331
283379944,0cyclictest329-21hwrng19:20:021
283379944,0cyclictest329-21hwrng00:30:181
283379944,0cyclictest329-21hwrng00:11:531
283379943,1cyclictest702-21snmpd23:25:011
283379943,1cyclictest702-21snmpd00:09:501
283379943,1cyclictest32204-21uniq21:35:131
283379943,1cyclictest25371-21gltestperf23:50:131
283379943,1cyclictest0-21swapper/122:55:161
283379942,2cyclictest2775-21cpuspeed_turbos00:00:121
283359944,0cyclictest329-21hwrng22:57:070
283359944,0cyclictest329-21hwrng22:25:220
283359944,0cyclictest329-21hwrng21:35:120
283359944,0cyclictest329-21hwrng19:34:220
283359944,0cyclictest0-21swapper/000:10:120
283359943,1cyclictest7599-21needreboot23:30:110
283359943,1cyclictest702-21snmpd23:44:570
283359943,1cyclictest702-21snmpd20:25:110
283359941,1cyclictest1968-21cat20:50:000
283499932,1cyclictest702-21snmpd21:25:183
283499932,1cyclictest431ktimers/320:50:153
283499932,1cyclictest431ktimers/319:40:203
283499932,1cyclictest29037-21wc19:10:153
283499931,2cyclictest7748-21ntpq23:30:123
283499931,2cyclictest431ktimers/321:20:123
283499930,1cyclictest0-21swapper/323:25:153
283379933,0cyclictest329-21hwrng20:45:011
283379933,0cyclictest329-21hwrng19:25:091
283379932,1cyclictest702-21snmpd20:40:021
283379932,1cyclictest702-21snmpd20:20:111
283379932,1cyclictest271ktimers/123:00:011
283379932,1cyclictest2397-21gltestperf20:50:151
283379932,1cyclictest0-21swapper/123:20:121
283379932,1cyclictest0-21swapper/119:55:151
283379931,2cyclictest27126-21sed20:30:191
283379931,2cyclictest16446-21awk00:15:131
283379930,3cyclictest26318-21idleruntime-cro20:30:001
283359932,1cyclictest702-21snmpd20:09:100
283359932,1cyclictest702-21snmpd19:46:040
283359930,1cyclictest0-21swapper/022:09:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional