You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 10:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot7.osadl.org (updated Fri May 09, 2025 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18526991918,1cyclictest60250irq/125-lan22:38:462
18526991817,1cyclictest60250irq/125-lan23:45:202
18526991817,1cyclictest60250irq/125-lan23:36:022
18526991817,1cyclictest60250irq/125-lan23:01:252
18526991817,1cyclictest60250irq/125-lan22:40:122
18526991817,1cyclictest60250irq/125-lan22:22:572
18526991817,1cyclictest60250irq/125-lan22:18:572
18526991817,1cyclictest60250irq/125-lan22:00:192
18526991817,1cyclictest60250irq/125-lan21:35:522
18526991817,1cyclictest60250irq/125-lan21:15:142
18526991817,1cyclictest60250irq/125-lan00:12:532
18526991717,0cyclictest60250irq/125-lan23:50:172
18526991717,0cyclictest60250irq/125-lan23:16:182
18526991717,0cyclictest60250irq/125-lan22:52:572
18526991717,0cyclictest60250irq/125-lan22:25:532
18526991717,0cyclictest60250irq/125-lan21:54:172
18526991717,0cyclictest60250irq/125-lan00:21:192
18526991717,0cyclictest60250irq/125-lan00:18:512
18526991716,1cyclictest60250irq/125-lan23:58:172
18526991716,1cyclictest60250irq/125-lan23:32:112
18526991716,1cyclictest60250irq/125-lan23:25:212
18526991716,1cyclictest60250irq/125-lan23:20:082
18526991716,1cyclictest60250irq/125-lan23:05:312
18526991716,1cyclictest60250irq/125-lan22:58:462
18526991716,1cyclictest60250irq/125-lan22:45:462
18526991716,1cyclictest60250irq/125-lan21:55:212
18526991716,1cyclictest60250irq/125-lan21:41:272
18526991716,1cyclictest60250irq/125-lan21:31:312
18526991716,1cyclictest60250irq/125-lan00:33:562
18526991616,0cyclictest60250irq/125-lan23:12:492
18526991616,0cyclictest60250irq/125-lan22:11:292
18526991616,0cyclictest60250irq/125-lan21:45:172
18526991616,0cyclictest60250irq/125-lan21:23:512
18526991615,1cyclictest60250irq/125-lan23:40:182
18526991615,1cyclictest60250irq/125-lan22:30:152
18526991615,1cyclictest60250irq/125-lan22:05:042
18526991615,1cyclictest60250irq/125-lan21:26:072
18526991615,1cyclictest60250irq/125-lan21:10:342
18526991615,1cyclictest60250irq/125-lan20:45:192
18526991615,1cyclictest60250irq/125-lan20:40:192
18526991615,1cyclictest60250irq/125-lan20:25:202
18526991615,1cyclictest60250irq/125-lan20:05:162
18526991615,1cyclictest60250irq/125-lan00:35:132
18526991615,1cyclictest60250irq/125-lan00:25:132
18526991615,1cyclictest60250irq/125-lan00:06:272
18526991615,1cyclictest60250irq/125-lan00:00:362
18526991514,1cyclictest60250irq/125-lan21:00:122
18526991514,1cyclictest60250irq/125-lan20:20:172
18526991514,1cyclictest60250irq/125-lan19:25:202
18526991414,0cyclictest60250irq/125-lan19:40:012
18526991413,1cyclictest60250irq/125-lan19:30:122
18522991414,0cyclictest329-21hwrng22:04:411
18522991414,0cyclictest329-21hwrng20:41:441
18522991414,0cyclictest329-21hwrng20:33:321
18522991414,0cyclictest329-21hwrng19:30:041
18517991414,0cyclictest329-21hwrng20:03:500
18526991313,0cyclictest60250irq/125-lan20:55:222
18526991313,0cyclictest60250irq/125-lan19:45:162
18526991313,0cyclictest60250irq/125-lan19:15:122
18526991312,1cyclictest60250irq/125-lan20:35:102
18526991312,1cyclictest60250irq/125-lan20:31:502
18526991312,1cyclictest60250irq/125-lan20:15:172
18526991312,1cyclictest60250irq/125-lan20:00:132
18526991312,1cyclictest60250irq/125-lan19:10:142
18522991313,0cyclictest329-21hwrng23:01:001
18522991313,0cyclictest329-21hwrng22:57:561
18522991313,0cyclictest329-21hwrng22:49:441
18526991212,0cyclictest60250irq/125-lan19:56:522
18522991212,0cyclictest329-21hwrng23:40:561
18522991212,0cyclictest329-21hwrng22:20:031
18522991212,0cyclictest329-21hwrng19:52:351
18522991212,0cyclictest329-21hwrng19:52:351
18522991212,0cyclictest329-21hwrng19:48:301
18526991111,0cyclictest60250irq/125-lan19:20:102
1852699109,1cyclictest60250irq/125-lan21:05:002
18522991010,0cyclictest329-21hwrng23:19:261
18522991010,0cyclictest329-21hwrng22:26:111
185269999,0cyclictest60250irq/125-lan20:13:002
185269999,0cyclictest60250irq/125-lan19:42:512
185229999,0cyclictest329-21hwrng23:46:031
185229999,0cyclictest329-21hwrng23:21:291
185229999,0cyclictest329-21hwrng21:43:111
185229999,0cyclictest329-21hwrng00:17:481
185229998,1cyclictest702-21snmpd19:37:201
185229998,1cyclictest271ktimers/121:57:261
185309988,0cyclictest702-21snmpd22:35:473
185309988,0cyclictest702-21snmpd21:50:573
185309988,0cyclictest702-21snmpd00:31:593
185309988,0cyclictest329-21hwrng22:06:443
185309988,0cyclictest329-21hwrng21:14:303
185309988,0cyclictest329-21hwrng21:04:163
185309986,2cyclictest702-21snmpd23:03:223
185269988,0cyclictest702-21snmpd19:53:062
185269988,0cyclictest702-21snmpd19:53:062
185229988,0cyclictest702-21snmpd22:35:531
185229988,0cyclictest702-21snmpd19:20:231
185229988,0cyclictest329-21hwrng21:11:261
185229988,0cyclictest329-21hwrng21:05:171
185229988,0cyclictest329-21hwrng00:28:021
185229987,1cyclictest702-21snmpd21:20:091
185229987,1cyclictest271ktimers/121:17:251
185229980,8cyclictest0-21swapper/122:15:261
185179988,0cyclictest702-21snmpd23:56:460
185179988,0cyclictest702-21snmpd00:30:290
185179988,0cyclictest702-21snmpd00:27:440
185179988,0cyclictest702-21snmpd00:08:070
185179987,1cyclictest702-21snmpd20:34:480
185179987,1cyclictest702-21snmpd19:30:170
185179987,1cyclictest702-21snmpd19:19:530
185179986,2cyclictest702-21snmpd22:07:550
185179984,1cyclictest6414-21cut21:15:000
185309977,0cyclictest702-21snmpd23:35:243
185309977,0cyclictest702-21snmpd21:57:073
185309977,0cyclictest702-21snmpd21:24:363
185309977,0cyclictest702-21snmpd21:05:443
185309977,0cyclictest702-21snmpd20:42:403
185309977,0cyclictest702-21snmpd20:35:313
185309977,0cyclictest702-21snmpd19:52:513
185309977,0cyclictest702-21snmpd19:52:513
185309977,0cyclictest702-21snmpd19:49:173
185309977,0cyclictest702-21snmpd19:41:413
185309977,0cyclictest329-21hwrng23:42:593
185309977,0cyclictest329-21hwrng22:30:163
185309977,0cyclictest329-21hwrng22:26:113
185309977,0cyclictest329-21hwrng22:18:003
185309977,0cyclictest329-21hwrng20:05:543
185309977,0cyclictest329-21hwrng19:21:523
185309977,0cyclictest329-21hwrng19:19:483
185309977,0cyclictest329-21hwrng00:27:013
185309977,0cyclictest329-21hwrng00:17:483
185309977,0cyclictest329-21hwrng00:05:313
185309977,0cyclictest329-21hwrng00:00:243
185309976,1cyclictest702-21snmpd23:52:523
185309976,1cyclictest702-21snmpd21:32:083
185269976,1cyclictest60250irq/125-lan20:50:172
185229977,0cyclictest702-21snmpd23:51:221
185229977,0cyclictest702-21snmpd23:32:391
185229977,0cyclictest702-21snmpd20:48:151
185229977,0cyclictest702-21snmpd20:01:351
185229977,0cyclictest702-21snmpd19:10:251
185229977,0cyclictest702-21snmpd00:02:251
185229977,0cyclictest329-21hwrng23:55:161
185229977,0cyclictest329-21hwrng23:27:371
185229977,0cyclictest329-21hwrng21:04:151
185229977,0cyclictest329-21hwrng20:56:041
185229977,0cyclictest329-21hwrng00:30:051
185229977,0cyclictest329-21hwrng00:21:541
185229977,0cyclictest271ktimers/120:19:251
185229976,1cyclictest271ktimers/121:51:261
185229976,1cyclictest271ktimers/120:51:261
185229975,2cyclictest702-21snmpd00:10:071
185229970,7cyclictest0-21swapper/121:45:261
185229970,7cyclictest0-21swapper/120:13:261
185229970,7cyclictest0-21swapper/100:07:261
185179977,0cyclictest702-21snmpd23:23:270
185179977,0cyclictest702-21snmpd23:07:480
185179977,0cyclictest702-21snmpd22:26:280
185179977,0cyclictest702-21snmpd20:38:340
185179977,0cyclictest702-21snmpd20:12:030
185179976,1cyclictest702-21snmpd19:27:500
185179976,1cyclictest702-21snmpd19:13:310
185309966,0cyclictest702-21snmpd22:58:533
185309966,0cyclictest702-21snmpd21:36:093
185309966,0cyclictest329-21hwrng22:45:373
185309966,0cyclictest329-21hwrng22:21:043
185309966,0cyclictest329-21hwrng20:01:483
185309966,0cyclictest329-21hwrng19:29:023
185309966,0cyclictest329-21hwrng19:14:423
185309966,0cyclictest329-21hwrng00:36:143
185309966,0cyclictest329-21hwrng00:21:543
185309965,1cyclictest702-21snmpd23:30:123
185309965,1cyclictest702-21snmpd22:00:283
185309965,1cyclictest702-21snmpd21:46:143
185309965,1cyclictest702-21snmpd20:53:443
185309965,1cyclictest16363-21cat23:10:153
185229966,0cyclictest702-21snmpd00:39:051
185229966,0cyclictest329-21hwrng23:35:491
185229966,0cyclictest329-21hwrng20:08:581
185229966,0cyclictest329-21hwrng19:55:401
185229966,0cyclictest329-21hwrng19:40:181
185229965,1cyclictest702-21snmpd23:08:181
185229965,1cyclictest702-21snmpd22:12:041
185229965,1cyclictest702-21snmpd20:21:071
185229965,1cyclictest271ktimers/123:10:261
185229965,1cyclictest271ktimers/121:35:261
185229965,1cyclictest271ktimers/121:33:261
185229965,1cyclictest271ktimers/120:37:261
185179966,0cyclictest702-21snmpd23:00:320
185179966,0cyclictest702-21snmpd22:58:230
185179966,0cyclictest702-21snmpd22:43:200
185179966,0cyclictest702-21snmpd22:32:340
185179966,0cyclictest702-21snmpd22:19:160
185179966,0cyclictest702-21snmpd21:57:400
185179966,0cyclictest702-21snmpd20:59:320
185179966,0cyclictest702-21snmpd20:53:530
185179966,0cyclictest702-21snmpd00:17:320
185179966,0cyclictest702-21snmpd00:00:070
185179965,1cyclictest702-21snmpd23:25:030
185179965,1cyclictest702-21snmpd00:39:080
185179964,2cyclictest16345-21cat23:10:140
185309955,0cyclictest702-21snmpd23:48:253
185309955,0cyclictest329-21hwrng23:21:293
185309955,0cyclictest329-21hwrng20:45:503
185309955,0cyclictest329-21hwrng19:31:043
185309954,1cyclictest702-21snmpd20:22:043
185309954,1cyclictest24614-21sendmail23:19:593
185309954,1cyclictest21227-21cat22:40:153
185309954,1cyclictest17135-21needreboot20:25:173
185309954,1cyclictest12543-21cat20:15:143
185309954,1cyclictest11066-21dump-pmu-power21:20:003
185309953,2cyclictest702-21snmpd23:25:543
185309950,5cyclictest10940-21turbostat23:09:553
185229955,0cyclictest702-21snmpd22:44:351
185229954,1cyclictest271ktimers/122:52:261
185229954,1cyclictest271ktimers/120:25:261
185229954,1cyclictest271ktimers/119:27:261
185229950,5cyclictest0-21swapper/122:07:261
185179955,0cyclictest702-21snmpd21:32:000
185179955,0cyclictest702-21snmpd19:37:310
185179955,0cyclictest329-21hwrng21:54:270
185179954,1cyclictest702-21snmpd22:47:260
185179954,1cyclictest702-21snmpd21:23:270
185179954,1cyclictest702-21snmpd21:07:350
185179954,1cyclictest537-21gmain22:12:290
185179953,2cyclictest30746-21ntpq21:40:170
185309944,0cyclictest702-21snmpd20:58:113
185309944,0cyclictest329-21hwrng20:11:003
185309944,0cyclictest329-21hwrng19:59:443
185309943,1cyclictest702-21snmpd22:51:053
185309943,1cyclictest702-21snmpd22:10:583
185309943,1cyclictest29439-21ntpq19:35:193
185309942,2cyclictest27650-21ssh23:58:013
185229944,0cyclictest702-21snmpd21:26:061
185229944,0cyclictest271ktimers/119:17:251
185229944,0cyclictest10766-21turbostat22:34:551
185179944,0cyclictest702-21snmpd20:05:570
185179944,0cyclictest329-21hwrng23:33:460
185179944,0cyclictest329-21hwrng23:15:200
185179944,0cyclictest329-21hwrng22:50:460
185179944,0cyclictest329-21hwrng21:36:010
185179944,0cyclictest329-21hwrng21:28:510
185179944,0cyclictest329-21hwrng21:00:100
185179944,0cyclictest329-21hwrng20:26:230
185179944,0cyclictest329-21hwrng19:55:400
185179944,0cyclictest329-21hwrng19:51:340
185179944,0cyclictest329-21hwrng19:51:330
185179944,0cyclictest329-21hwrng19:45:250
185179944,0cyclictest329-21hwrng19:23:540
185179944,0cyclictest30973-21cut19:40:130
185179943,1cyclictest702-21snmpd21:19:200
185179943,1cyclictest151ktimers/022:00:190
185179943,1cyclictest0-21swapper/021:45:140
185179942,2cyclictest702-21snmpd23:50:580
185179942,2cyclictest702-21snmpd23:45:550
185179942,2cyclictest702-21snmpd22:21:160
185179942,2cyclictest702-21snmpd20:23:070
185179942,2cyclictest12233-21cut20:15:110
185179941,3cyclictest17455-21turbostat00:25:000
185179941,2cyclictest6325-21ssh23:35:040
185309932,1cyclictest431ktimers/321:40:373
185309932,1cyclictest431ktimers/300:10:353
185309932,1cyclictest18458-21/usr/sbin/munin20:30:163
185179932,1cyclictest6053-21ntpq00:10:180
185179931,2cyclictest702-21snmpd20:42:370
185179931,2cyclictest24611-21forks20:45:150
185179930,1cyclictest171rcu_preempt22:36:370
185179930,1cyclictest0-21swapper/023:40:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional