You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 06:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Mon Dec 29, 2025 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
192802275243,21sleep10-21swapper/119:08:301
193182265235,19sleep20-21swapper/219:08:592
193452258227,21sleep30-21swapper/319:09:213
191072253221,21sleep00-21swapper/019:06:320
306762650,0sleep30-21swapper/323:50:013
199622630,0sleep30-21swapper/323:06:253
9532610,0sleep30-21swapper/320:50:133
3022590,0sleep20-21swapper/223:32:212
238082540,0sleep20-21swapper/221:17:482
129172540,0sleep00-21swapper/023:39:570
78782180,0sleep10-21swapper/123:36:181
52562180,0sleep10-21swapper/119:45:211
294272180,0sleep30-21swapper/300:07:193
156132160,0sleep10-21swapper/122:08:321
241392150,0sleep00-21swapper/000:04:470
254602140,0sleep10-21swapper/122:50:531
1950599143,9cyclictest19417-21sh22:29:352
1950599140,9cyclictest10854-21ssh23:56:302
1950599140,10cyclictest9148-21ssh22:41:412
93532130,0sleep10-21swapper/123:55:231
51422130,0sleep10-21swapper/100:11:521
1950599132,7cyclictest31426-21ssh21:21:572
1950599130,9cyclictest25215-21sh22:50:422
1950599130,7cyclictest275-21systemd-journal21:50:012
1950599130,5cyclictest28040-21idleruntime-cro20:39:592
1950599130,10cyclictest31360-21sh21:59:062
1950599120,9cyclictest9291-21diskmemload23:01:102
1950599120,9cyclictest8736-21ssh23:36:552
1950599120,9cyclictest8318-21ssh00:32:252
1950599120,9cyclictest8046-21rm23:18:362
1950599120,9cyclictest6427-21ssh23:54:352
1950599120,9cyclictest553-21ssh21:40:512
1950599120,9cyclictest3277-21sh00:10:322
1950599120,9cyclictest28787-21ssh22:15:282
1950599120,9cyclictest27006-21rm21:37:512
1950599120,9cyclictest23987-21ssh22:13:182
1950599120,9cyclictest19732-21ssh21:33:562
1950599120,9cyclictest18877-21ssh21:51:262
1950599120,9cyclictest18737-21ssh23:05:312
1950599120,9cyclictest1870-21ssh22:55:582
1950599120,9cyclictest18216-21ssh23:24:372
1950599120,9cyclictest15785-21ssh22:08:402
1950599120,8cyclictest26615-21ssh23:47:172
1950599120,8cyclictest22521-21ssh22:30:322
1950599120,8cyclictest19366-21ssh00:01:212
1950599120,8cyclictest15343-21ssh00:17:582
132012120,0sleep30-21swapper/300:35:173
1950599112,8cyclictest29285-21apt-get22:35:122
1950599110,9cyclictest2710-21ssh00:29:392
1950599110,8cyclictest9291-21diskmemload22:47:112
1950599110,8cyclictest644-21ssh22:00:092
1950599110,8cyclictest4529-21sh22:20:192
1950599110,8cyclictest4074-21ssh21:25:092
1950599110,8cyclictest22738-21ssh23:26:372
1950599110,8cyclictest18765-21grep00:20:132
1950599110,8cyclictest13500-21ssh21:11:442
1950599110,8cyclictest13318-21ssh23:40:032
1950599110,8cyclictest12447-21ssh00:35:122
1950599110,6cyclictest29870-21cstates19:30:132
1950599110,6cyclictest25973-21ssh00:05:152
1950599110,6cyclictest2554-21grep19:40:202
1950599110,5cyclictest26280-21/usr/sbin/munin23:10:162
1950999108,1cyclictest34-21ksoftirqd/300:00:013
1950599100,9cyclictest32489-21ls20:49:592
1950599100,8cyclictest275-21systemd-journal20:10:002
1950599100,6cyclictest4762-21ntpq19:45:172
1950599100,6cyclictest28543-21awk19:25:202
1950599100,5cyclictest3518-21awk20:55:192
195059993,6cyclictest501-21in:imuxsock20:15:012
195059992,6cyclictest32588-21sed19:35:162
195059990,8cyclictest19697-21/usr/sbin/munin19:10:192
195059990,8cyclictest0-21swapper/220:30:122
195059990,7cyclictest6432-21taskset21:01:172
195059990,7cyclictest12394-21chrt20:04:192
195059990,5cyclictest7713-21diskstats21:05:172
195059990,5cyclictest28310-21grep20:40:112
195059990,5cyclictest24112-21awk19:15:222
195099987,1cyclictest34-21ksoftirqd/321:50:013
195099984,3cyclictest504-21dbus-daemon19:35:003
195099983,4cyclictest0-21swapper/300:30:123
195099980,7cyclictest23790-21ssh00:22:463
195059980,7cyclictest8454-21ls19:55:142
195059980,7cyclictest6166-21cpuspeed_turbos19:50:122
195059980,7cyclictest24820-21cmp19:20:012
195059980,7cyclictest2303-21munin-run20:55:002
195059980,7cyclictest19404-21apt-get20:20:152
195059980,7cyclictest17682-21grep20:15:182
195059980,7cyclictest0-21swapper/220:25:122
195029982,3cyclictest773-21awk00:10:001
194989983,3cyclictest275-21systemd-journal23:55:230
194989980,5cyclictest21372-21awk20:25:000
194989980,2cyclictest10525-21rm21:46:440
195099976,1cyclictest34-21ksoftirqd/321:10:003
195099976,1cyclictest34-21ksoftirqd/319:15:003
195099973,3cyclictest658-21snmpd22:16:473
195099973,3cyclictest275-21systemd-journal22:57:563
195099973,3cyclictest275-21systemd-journal19:45:003
195099973,3cyclictest275-21systemd-journal19:37:213
195099973,1cyclictest0-21swapper/321:35:373
195029973,3cyclictest504-21dbus-daemon21:57:411
195029973,3cyclictest275-21systemd-journal19:54:091
195029973,3cyclictest26467-11brltty22:32:421
195029972,3cyclictest27080-21turbostat19:25:011
195029972,3cyclictest21379-21dump-pmu-power20:25:011
195029970,6cyclictest25301-21ssh23:10:041
194989973,3cyclictest28833-21wc22:35:010
194989972,3cyclictest275-21systemd-journal20:30:010
194989972,3cyclictest2297-21turbostat20:55:010
194989971,3cyclictest28040-21idleruntime-cro20:39:590
1356270,0sleep30-21swapper/322:37:213
9566260,0sleep00-21swapper/021:27:580
195099966,0cyclictest0-21swapper/322:25:223
195099966,0cyclictest0-21swapper/322:06:523
195099965,1cyclictest34-21ksoftirqd/319:50:013
195099963,2cyclictest9273-21ssh23:37:193
195099963,2cyclictest658-21snmpd23:41:543
195099963,2cyclictest3554-21sh00:10:443
195099963,2cyclictest32742-21ssh21:22:513
195099963,2cyclictest31623-21cut21:40:163
195099963,2cyclictest29185-21ssh21:57:323
195099963,2cyclictest275-21systemd-journal19:18:383
195099963,2cyclictest17761-21ssh21:14:473
195099963,2cyclictest13917-21ssh23:03:213
195099963,1cyclictest0-21swapper/322:45:233
195099963,1cyclictest0-21swapper/322:03:483
195099962,3cyclictest8591-21ntpq23:55:173
195099962,3cyclictest658-21snmpd23:52:463
195099962,3cyclictest658-21snmpd22:20:043
195099962,3cyclictest658-21snmpd20:46:313
195099962,3cyclictest658-21snmpd20:24:153
195099962,3cyclictest658-21snmpd20:15:393
195099962,3cyclictest658-21snmpd20:00:203
195099962,3cyclictest658-21snmpd19:54:483
195099962,3cyclictest504-21dbus-daemon00:26:443
195099962,2cyclictest275-21systemd-journal20:40:023
195099962,1cyclictest0-21swapper/322:30:423
195099962,1cyclictest0-21swapper/321:30:523
195099962,1cyclictest0-21swapper/300:15:503
195099960,3cyclictest18640-21/usr/sbin/munin22:10:173
195099960,2cyclictest19686-21diskstats23:25:133
195099960,0cyclictest0-21swapper/323:20:493
195099960,0cyclictest0-21swapper/321:18:513
195029966,0cyclictest0-21swapper/122:00:131
195029966,0cyclictest0-21swapper/100:30:191
195029966,0cyclictest0-21swapper/100:24:541
195029964,1cyclictest4988-21ssh22:20:241
195029963,3cyclictest5322-21kworker/1:221:23:221
195029963,2cyclictest9291-21diskmemload21:15:161
195029963,2cyclictest501-21in:imuxsock21:07:361
195029963,2cyclictest27661-21wc23:30:011
195029963,2cyclictest24116-21ssh23:45:261
195029963,2cyclictest18035-21rm21:50:501
195029963,2cyclictest12871-21ssh21:30:101
195029963,2cyclictest11000-21grep20:00:151
195029963,2cyclictest1028-21unixbench_multi22:55:251
195029963,2cyclictest0-21swapper/120:20:011
195029963,1cyclictest0-21swapper/100:18:491
195029962,4cyclictest5322-21kworker/1:223:22:031
195029962,4cyclictest5322-21kworker/1:223:05:141
195029962,4cyclictest5322-21kworker/1:221:45:401
195029962,4cyclictest5322-21kworker/1:221:38:501
195029962,4cyclictest5322-21kworker/1:200:35:231
195029962,3cyclictest658-21snmpd23:40:461
195029962,3cyclictest658-21snmpd22:48:301
195029962,3cyclictest658-21snmpd21:43:271
195029962,3cyclictest658-21snmpd20:57:441
195029962,3cyclictest658-21snmpd20:11:461
195029962,3cyclictest658-21snmpd19:40:261
195029962,3cyclictest5980-21expr22:40:141
195029962,3cyclictest3514-11brltty21:00:281
195029962,3cyclictest3514-11brltty19:57:551
195029962,3cyclictest32000-21expr19:35:111
195029962,3cyclictest28295-21find23:30:161
195029962,3cyclictest28231-21cat00:25:161
195029962,3cyclictest275-21systemd-journal22:17:441
195029962,3cyclictest26292-21cat20:35:141
195029962,3cyclictest22450-21sshd00:03:331
195029962,3cyclictest19945-21cat19:10:131
195029962,3cyclictest12657-21cat22:25:161
195029961,5cyclictest5322-21kworker/1:221:10:151
195029961,4cyclictest9145-21ntpq23:00:211
195029960,6cyclictest0-21swapper/121:27:131
195029960,5cyclictest674-21lldpd19:29:221
194989966,0cyclictest0-21swapper/023:00:340
194989966,0cyclictest0-21swapper/021:55:150
194989964,1cyclictest1721-21tr19:40:150
194989963,2cyclictest8483-21sh22:22:550
194989963,2cyclictest6595-21ntp_kernel_pll_22:40:160
194989963,2cyclictest658-21snmpd19:18:530
194989963,2cyclictest658-21snmpd00:15:170
194989963,2cyclictest6220-21sh00:30:520
194989963,2cyclictest3718-21ssh22:57:180
194989963,2cyclictest32257-21sh22:36:160
194989963,2cyclictest26652-21head00:05:210
194989963,2cyclictest22177-21sed20:25:140
194989963,2cyclictest21257-21ssh21:15:580
194989963,2cyclictest12527-21sh23:20:330
194989963,1cyclictest0-21swapper/023:05:300
194989962,3cyclictest658-21snmpd23:11:330
194989962,3cyclictest658-21snmpd21:21:250
194989962,3cyclictest658-21snmpd20:47:200
194989962,3cyclictest658-21snmpd20:16:120
194989962,3cyclictest658-21snmpd20:06:030
194989962,3cyclictest658-21snmpd20:02:120
194989962,3cyclictest658-21snmpd19:47:410
194989962,3cyclictest658-21snmpd19:35:140
194989962,3cyclictest658-21snmpd19:30:460
194989962,3cyclictest658-21snmpd00:26:320
194989962,3cyclictest5470-21cat21:00:170
194989962,3cyclictest4379-21seq23:53:060
194989962,3cyclictest27703-21sed23:30:010
194989962,3cyclictest275-21systemd-journal23:31:590
194989962,3cyclictest275-21systemd-journal22:01:250
194989962,3cyclictest26467-11brltty22:13:300
194989962,3cyclictest25178-21cat19:20:120
194989962,3cyclictest2427-21cut00:10:190
194989962,3cyclictest23580-21tail22:50:120
194989962,3cyclictest2345-21perl23:15:150
194989962,3cyclictest17005-21sshd22:27:510
194989962,1cyclictest0-21swapper/023:43:320
194989962,1cyclictest0-21swapper/021:52:410
194989962,1cyclictest0-21swapper/021:40:500
194989962,1cyclictest0-21swapper/000:22:270
194989961,5cyclictest12-21ksoftirqd/022:05:390
194989960,6cyclictest0-21swapper/022:46:220
194989960,6cyclictest0-21swapper/022:16:190
194989960,5cyclictest6994-21ntp_states19:50:180
555250,0sleep10-21swapper/120:50:121
195099952,2cyclictest658-21snmpd22:40:083
195099952,2cyclictest658-21snmpd20:30:163
195099952,2cyclictest658-21snmpd19:21:073
195099952,2cyclictest5687-21needreboot21:00:183
195099952,2cyclictest3115-21expr20:55:153
195099952,2cyclictest28876-21perl23:30:173
195099952,2cyclictest27618-21cat19:25:123
195099952,2cyclictest26130-21cat20:35:143
195099952,2cyclictest2375-21head23:15:143
195099952,2cyclictest23228-21expr22:50:113
195099952,2cyclictest21591-21taskset20:25:043
195099952,2cyclictest15818-21expr21:50:143
195099952,2cyclictest15206-21cat20:10:143
195099952,2cyclictest13786-21wc20:05:183
195099951,3cyclictest658-21snmpd21:25:023
195099951,3cyclictest25313-21seq23:10:063
195099950,4cyclictest8240-21/usr/sbin/munin19:55:143
195029953,1cyclictest31728-21sensors_temp20:45:191
195029952,2cyclictest31021-21ssh23:50:021
195029952,2cyclictest30343-21sh22:35:181
195029952,2cyclictest30224-21cat19:30:161
195029952,2cyclictest28535-21cat20:40:121
195029952,2cyclictest21765-21grep20:25:121
195029952,2cyclictest2067-21expr23:15:131
195029952,2cyclictest18317-21cat22:10:151
195029951,3cyclictest658-21snmpd20:32:361
195029951,3cyclictest658-21snmpd20:06:121
195029951,3cyclictest23080-21expr19:15:161
194989953,1cyclictest122362sleep000:35:020
194989952,2cyclictest8919-21cat19:55:170
194989952,2cyclictest658-21snmpd21:05:040
194989952,2cyclictest658-21snmpd20:55:020
194989952,2cyclictest29200-21netstat20:40:170
194989952,2cyclictest21516-21ssh21:35:040
194989952,2cyclictest14899-21date20:10:010
194989952,2cyclictest12669-21rm21:30:020
194989952,1cyclictest0-21swapper/021:10:110
194989951,3cyclictest658-21snmpd23:45:120
194989951,3cyclictest658-21snmpd19:25:130
194989951,3cyclictest275-21systemd-journal19:10:430
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional