You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-03-18 - 15:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot7.osadl.org (updated Tue Mar 18, 2025 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6572991919,0cyclictest60250irq/125-lan12:30:002
6572991919,0cyclictest60250irq/125-lan07:30:032
6572991818,0cyclictest60250irq/125-lan10:52:192
6572991817,1cyclictest60250irq/125-lan12:32:282
6572991817,1cyclictest60250irq/125-lan12:16:042
6572991817,1cyclictest60250irq/125-lan12:00:162
6572991817,1cyclictest60250irq/125-lan11:52:312
6572991817,1cyclictest60250irq/125-lan11:45:462
6572991817,1cyclictest60250irq/125-lan11:24:582
6572991817,1cyclictest60250irq/125-lan11:06:332
6572991817,1cyclictest60250irq/125-lan10:48:412
6572991817,1cyclictest60250irq/125-lan10:43:562
6572991817,1cyclictest60250irq/125-lan09:50:032
6572991817,1cyclictest60250irq/125-lan09:12:262
6572991816,1cyclictest60250irq/125-lan11:12:002
6572991717,0cyclictest60250irq/125-lan12:36:102
6572991717,0cyclictest60250irq/125-lan12:20:052
6572991717,0cyclictest60250irq/125-lan11:00:112
6572991717,0cyclictest60250irq/125-lan10:28:372
6572991717,0cyclictest60250irq/125-lan10:00:122
6572991717,0cyclictest60250irq/125-lan09:35:162
6572991717,0cyclictest60250irq/125-lan09:35:152
6572991716,1cyclictest60250irq/125-lan11:56:522
6572991716,1cyclictest60250irq/125-lan11:44:322
6572991716,1cyclictest60250irq/125-lan11:37:112
6572991716,1cyclictest60250irq/125-lan11:32:362
6572991716,1cyclictest60250irq/125-lan10:55:562
6572991716,1cyclictest60250irq/125-lan10:35:162
6572991716,1cyclictest60250irq/125-lan10:18:422
6572991716,1cyclictest60250irq/125-lan10:10:262
6572991716,1cyclictest60250irq/125-lan09:55:152
6572991716,1cyclictest60250irq/125-lan09:47:492
6572991716,1cyclictest60250irq/125-lan09:40:102
6572991716,1cyclictest60250irq/125-lan09:40:102
6572991716,1cyclictest60250irq/125-lan07:40:142
6572991715,1cyclictest60250irq/125-lan12:10:002
6572991616,0cyclictest60250irq/125-lan10:31:532
6572991616,0cyclictest60250irq/125-lan10:22:012
6572991616,0cyclictest60250irq/125-lan09:19:582
6572991616,0cyclictest60250irq/125-lan08:50:222
6572991616,0cyclictest60250irq/125-lan08:44:122
6572991615,1cyclictest60250irq/125-lan12:05:342
6572991615,1cyclictest60250irq/125-lan10:07:032
6572991615,1cyclictest60250irq/125-lan09:34:112
6572991615,1cyclictest60250irq/125-lan09:25:172
6572991615,1cyclictest60250irq/125-lan08:20:012
6572991615,1cyclictest60250irq/125-lan08:09:142
6572991615,1cyclictest60250irq/125-lan07:45:132
6572991615,1cyclictest60250irq/125-lan07:10:162
6572991515,0cyclictest60250irq/125-lan09:20:362
6572991514,1cyclictest60250irq/125-lan11:25:082
6572991514,1cyclictest60250irq/125-lan11:15:142
6572991514,1cyclictest60250irq/125-lan08:55:152
6572991514,1cyclictest60250irq/125-lan08:33:282
6572991414,0cyclictest60250irq/125-lan09:00:182
6572991414,0cyclictest60250irq/125-lan07:55:132
6572991414,0cyclictest60250irq/125-lan07:15:152
6572991413,1cyclictest60250irq/125-lan08:25:162
6572991413,1cyclictest60250irq/125-lan07:50:232
6572991413,1cyclictest60250irq/125-lan07:25:172
6572991313,0cyclictest329-21hwrng08:10:052
6572991312,1cyclictest60250irq/125-lan08:00:372
6572991211,1cyclictest60250irq/125-lan07:35:162
6572991111,0cyclictest60250irq/125-lan08:48:542
657299109,1cyclictest60250irq/125-lan08:20:192
6572991010,0cyclictest60250irq/125-lan08:35:122
65769998,1cyclictest702-21snmpd09:20:353
65729998,1cyclictest60250irq/125-lan09:05:162
65679999,0cyclictest329-21hwrng09:00:161
65629998,1cyclictest702-21snmpd08:42:190
65769988,0cyclictest702-21snmpd12:38:013
65769988,0cyclictest702-21snmpd11:49:433
65769988,0cyclictest702-21snmpd11:27:173
65769988,0cyclictest702-21snmpd10:31:353
65769988,0cyclictest702-21snmpd09:07:533
65769988,0cyclictest329-21hwrng11:31:483
65769988,0cyclictest329-21hwrng07:25:023
65769988,0cyclictest329-21hwrng07:12:443
65769987,1cyclictest702-21snmpd12:30:163
65769987,1cyclictest702-21snmpd08:50:103
65679988,0cyclictest702-21snmpd11:28:261
65679988,0cyclictest702-21snmpd09:55:131
65679988,0cyclictest702-21snmpd09:05:561
65679988,0cyclictest329-21hwrng12:27:061
65679988,0cyclictest329-21hwrng12:04:351
65679988,0cyclictest329-21hwrng11:56:231
65679988,0cyclictest329-21hwrng11:15:251
65679988,0cyclictest329-21hwrng10:35:291
65679988,0cyclictest329-21hwrng09:45:181
65679988,0cyclictest329-21hwrng09:29:561
65679988,0cyclictest329-21hwrng09:13:331
65679988,0cyclictest329-21hwrng08:38:441
65679988,0cyclictest329-21hwrng07:39:211
65679988,0cyclictest329-21hwrng07:23:591
65679987,1cyclictest702-21snmpd08:10:181
65679986,2cyclictest702-21snmpd11:54:411
65679986,2cyclictest702-21snmpd09:21:031
65629988,0cyclictest702-21snmpd12:18:580
65629988,0cyclictest702-21snmpd12:12:540
65629988,0cyclictest702-21snmpd10:12:080
65629988,0cyclictest702-21snmpd09:50:210
65629988,0cyclictest702-21snmpd07:28:440
65629988,0cyclictest702-21snmpd07:23:490
65629988,0cyclictest329-21hwrng12:20:570
65629988,0cyclictest329-21hwrng11:41:010
65629988,0cyclictest329-21hwrng11:39:590
65629988,0cyclictest329-21hwrng08:36:420
65629988,0cyclictest329-21hwrng07:36:170
65629987,1cyclictest702-21snmpd08:32:250
65769977,0cyclictest702-21snmpd11:20:373
65769977,0cyclictest702-21snmpd11:15:513
65769977,0cyclictest702-21snmpd11:14:193
65769977,0cyclictest702-21snmpd10:03:403
65769977,0cyclictest702-21snmpd09:57:123
65769977,0cyclictest702-21snmpd09:45:243
65769977,0cyclictest702-21snmpd09:41:103
65769977,0cyclictest702-21snmpd09:41:093
65769977,0cyclictest329-21hwrng10:55:583
65769977,0cyclictest329-21hwrng08:56:103
65769977,0cyclictest329-21hwrng07:20:553
65769977,0cyclictest329-21hwrng07:19:543
65769976,1cyclictest702-21snmpd11:35:563
65769976,1cyclictest702-21snmpd10:45:173
65769976,1cyclictest702-21snmpd10:23:383
65769976,1cyclictest702-21snmpd10:19:103
65769976,1cyclictest702-21snmpd09:31:273
65769976,1cyclictest702-21snmpd07:45:123
65769976,1cyclictest702-21snmpd07:37:253
65769975,2cyclictest702-21snmpd10:36:363
65729976,1cyclictest60250irq/125-lan07:20:152
65679977,0cyclictest702-21snmpd11:22:001
65679977,0cyclictest702-21snmpd10:42:451
65679977,0cyclictest702-21snmpd08:22:301
65679977,0cyclictest702-21snmpd07:28:381
65679977,0cyclictest329-21hwrng12:34:161
65679977,0cyclictest329-21hwrng12:21:581
65679977,0cyclictest329-21hwrng11:45:071
65679977,0cyclictest329-21hwrng11:01:041
65679977,0cyclictest329-21hwrng10:57:001
65679977,0cyclictest329-21hwrng10:30:211
65679977,0cyclictest329-21hwrng10:17:021
65679977,0cyclictest329-21hwrng09:51:271
65679977,0cyclictest329-21hwrng09:43:161
65679977,0cyclictest329-21hwrng09:43:161
65679977,0cyclictest329-21hwrng09:34:031
65679977,0cyclictest329-21hwrng08:50:001
65679977,0cyclictest329-21hwrng08:42:501
65679977,0cyclictest329-21hwrng08:02:551
65679977,0cyclictest329-21hwrng07:50:371
65679977,0cyclictest329-21hwrng07:40:221
65679977,0cyclictest329-21hwrng07:32:121
65679977,0cyclictest329-21hwrng07:15:481
65679976,1cyclictest702-21snmpd12:06:381
65679976,1cyclictest702-21snmpd09:19:181
65679976,1cyclictest702-21snmpd08:57:011
65629977,0cyclictest702-21snmpd11:56:540
65629977,0cyclictest702-21snmpd10:29:500
65629977,0cyclictest702-21snmpd09:55:220
65629977,0cyclictest702-21snmpd09:25:110
65629977,0cyclictest702-21snmpd07:16:590
65629977,0cyclictest329-21hwrng11:50:130
65629977,0cyclictest329-21hwrng11:48:120
65629977,0cyclictest329-21hwrng11:25:400
65629977,0cyclictest329-21hwrng11:22:350
65629977,0cyclictest329-21hwrng11:15:250
65629977,0cyclictest329-21hwrng11:11:200
65629977,0cyclictest329-21hwrng11:00:040
65629977,0cyclictest329-21hwrng10:51:510
65629977,0cyclictest329-21hwrng10:40:370
65629977,0cyclictest329-21hwrng10:16:010
65629977,0cyclictest329-21hwrng08:25:260
65629977,0cyclictest329-21hwrng08:22:220
65629977,0cyclictest329-21hwrng07:50:370
65629977,0cyclictest329-21hwrng07:46:320
65629977,0cyclictest329-21hwrng07:40:220
65629977,0cyclictest329-21hwrng07:30:090
65629976,1cyclictest702-21snmpd10:35:210
65769966,0cyclictest702-21snmpd07:42:573
65769965,1cyclictest702-21snmpd10:44:273
65769965,1cyclictest702-21snmpd10:08:563
65769965,1cyclictest702-21snmpd09:15:333
65769965,1cyclictest702-21snmpd08:42:233
65769965,1cyclictest702-21snmpd08:35:573
65679966,0cyclictest702-21snmpd07:56:351
65679966,0cyclictest702-21snmpd07:11:051
65679966,0cyclictest329-21hwrng12:39:221
65679966,0cyclictest329-21hwrng11:10:181
65679966,0cyclictest329-21hwrng11:09:171
65679966,0cyclictest329-21hwrng10:28:191
65679966,0cyclictest329-21hwrng10:21:091
65679966,0cyclictest329-21hwrng08:46:571
65679966,0cyclictest329-21hwrng07:45:301
65679965,1cyclictest702-21snmpd08:33:071
65679965,1cyclictest6107-21cat11:40:141
65629966,0cyclictest702-21snmpd12:08:590
65629966,0cyclictest702-21snmpd10:48:470
65629966,0cyclictest702-21snmpd09:48:120
65629966,0cyclictest702-21snmpd09:08:570
65629966,0cyclictest702-21snmpd08:51:560
65629966,0cyclictest329-21hwrng12:36:180
65629966,0cyclictest329-21hwrng09:12:320
65629965,1cyclictest702-21snmpd08:18:370
65629965,1cyclictest702-21snmpd07:55:050
65629965,1cyclictest702-21snmpd07:11:320
65769955,0cyclictest702-21snmpd10:27:323
65769955,0cyclictest702-21snmpd09:50:523
65769955,0cyclictest702-21snmpd09:03:533
65769955,0cyclictest702-21snmpd08:17:043
65769955,0cyclictest329-21hwrng07:59:513
65769955,0cyclictest11241-21ssh11:07:373
65769954,1cyclictest702-21snmpd12:16:033
65769954,1cyclictest702-21snmpd11:44:203
65679955,0cyclictest329-21hwrng12:19:561
65679954,1cyclictest702-21snmpd10:12:111
65629955,0cyclictest702-21snmpd09:20:390
65629955,0cyclictest702-21snmpd09:16:270
65629955,0cyclictest702-21snmpd08:58:100
65629955,0cyclictest329-21hwrng11:08:140
65629954,1cyclictest702-21snmpd12:03:330
65629954,1cyclictest702-21snmpd08:47:500
65629953,2cyclictest702-21snmpd10:05:050
65769944,0cyclictest702-21snmpd08:01:003
65769944,0cyclictest329-21hwrng12:03:323
65769944,0cyclictest329-21hwrng11:51:163
65769944,0cyclictest329-21hwrng10:54:573
65769943,1cyclictest702-21snmpd11:59:063
65769943,1cyclictest702-21snmpd08:05:293
65769943,1cyclictest27850-21kworker/3:1+events_freezable_power_08:14:173
65769943,1cyclictest27850-21kworker/3:1+events_freezable_power_07:30:203
65769942,2cyclictest7613-21awk09:35:113
65769942,2cyclictest7613-21awk09:35:113
65769942,2cyclictest702-21snmpd12:10:273
65769942,2cyclictest702-21snmpd09:28:473
65769942,2cyclictest702-21snmpd09:10:063
65769942,2cyclictest6887-21head08:30:193
65769942,2cyclictest10722-21ssh12:20:013
65769941,2cyclictest19515-21ssh12:29:193
65679944,0cyclictest702-21snmpd08:06:411
65679944,0cyclictest329-21hwrng12:10:431
65679944,0cyclictest329-21hwrng10:49:491
65679943,1cyclictest702-21snmpd10:02:041
65679942,2cyclictest832-21ssh11:35:111
65679942,2cyclictest702-21snmpd09:35:431
65679942,2cyclictest702-21snmpd09:35:421
65679942,2cyclictest29616-21ssh10:05:221
65679941,1cyclictest0-21swapper/110:55:001
65629944,0cyclictest329-21hwrng10:20:070
65629944,0cyclictest329-21hwrng08:10:040
65629943,1cyclictest21237-21ntpq12:30:130
65629943,1cyclictest15328-21fschecks_count10:30:080
65629943,1cyclictest151ktimers/012:29:430
65629943,1cyclictest13437-21sshd09:41:540
65629943,1cyclictest13437-21sshd09:41:540
65629942,2cyclictest422-21systemd-resolve11:30:260
65629942,2cyclictest26850-21diskstats08:00:130
65769932,1cyclictest702-21snmpd07:51:173
65769932,1cyclictest27850-21kworker/3:1+events_freezable_power_08:25:153
65769932,1cyclictest2155-21sh10:11:493
65769930,3cyclictest2934-21ntpq08:20:153
65769930,3cyclictest13012-21/usr/sbin/munin08:45:193
65769930,2cyclictest6507-21grep11:00:133
65769930,1cyclictest0-21swapper/312:05:213
65679932,1cyclictest271ktimers/111:32:451
65679931,2cyclictest514-21grep08:15:141
65679931,2cyclictest4509-21fw_packets08:25:141
65629933,0cyclictest329-21hwrng10:55:580
65629933,0cyclictest329-21hwrng09:36:060
65629933,0cyclictest329-21hwrng09:36:050
65629932,1cyclictest29107-21cat08:05:140
65629932,1cyclictest27532-21sh10:01:190
65629931,2cyclictest3935-21gltestperf09:30:140
65629931,2cyclictest18316-21diskstats09:00:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional