You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 03:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Mon Dec 22, 2025 00:45:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
124082208149,21sleep30-21swapper/319:07:033
125252207144,24sleep10-21swapper/119:08:331
124152198159,25sleep00-21swapper/019:07:070
124072198159,25sleep20-21swapper/219:07:012
37972180,0sleep10-21swapper/121:05:151
135162170,1sleep313518-21latency_hist22:35:003
194002160,1sleep219404-21latency22:45:162
260192150,1sleep2271rcuc/223:00:132
1273499130,1cyclictest0-21swapper/119:40:101
12728991312,1cyclictest9-21ksoftirqd/023:45:010
12728991311,1cyclictest9-21ksoftirqd/019:20:000
12750991110,1cyclictest35-21ksoftirqd/321:20:013
1274399119,1cyclictest28-21ksoftirqd/220:50:012
1274399119,1cyclictest28-21ksoftirqd/220:10:002
1272899110,5cyclictest0-21swapper/022:15:150
1275099109,1cyclictest35-21ksoftirqd/300:40:003
1274399109,1cyclictest0-21swapper/220:39:592
1272899108,1cyclictest9-21ksoftirqd/023:40:000
1272899108,1cyclictest9-21ksoftirqd/023:25:000
1272899108,1cyclictest9-21ksoftirqd/021:30:000
1272899108,1cyclictest9-21ksoftirqd/019:45:110
127509997,1cyclictest5244-21latency22:15:193
127439997,1cyclictest28-21ksoftirqd/222:55:002
127439997,1cyclictest28-21ksoftirqd/221:40:132
127439997,1cyclictest28-21ksoftirqd/220:25:002
127439997,1cyclictest28-21ksoftirqd/200:39:592
127289998,1cyclictest9-21ksoftirqd/020:55:010
127289998,1cyclictest9-21ksoftirqd/000:29:590
127289997,1cyclictest9-21ksoftirqd/000:20:000
127289991,4cyclictest18269-21cut22:45:000
127509987,1cyclictest35-21ksoftirqd/323:00:003
127509986,1cyclictest707-21snmpd20:47:553
127509981,6cyclictest28880-21apt-get00:15:133
127509980,7cyclictest23066-21diskstats21:45:133
127439986,1cyclictest707-21snmpd23:20:202
127439985,1cyclictest28-21ksoftirqd/219:35:012
127439983,2cyclictest28-21ksoftirqd/220:30:142
127439981,6cyclictest0-21swapper/221:57:562
127439980,4cyclictest16649-21latency_hist23:50:002
127349980,2cyclictest0-21swapper/119:50:131
127289987,1cyclictest707-21snmpd22:47:270
127289986,1cyclictest7948-21cron21:15:000
127289986,1cyclictest707-21snmpd22:35:200
127289986,1cyclictest707-21snmpd22:30:500
127289986,1cyclictest707-21snmpd20:30:370
127289986,1cyclictest707-21snmpd19:23:440
127289986,1cyclictest707-21snmpd00:04:440
127289980,4cyclictest31810-21perf22:05:010
127289980,4cyclictest10386-21sed21:20:000
127509976,1cyclictest707-21snmpd23:29:523
127509976,1cyclictest707-21snmpd22:50:343
127509976,1cyclictest707-21snmpd19:19:503
127509976,1cyclictest707-21snmpd00:07:423
127509976,1cyclictest35-21ksoftirqd/323:05:003
127509975,1cyclictest707-21snmpd00:33:133
127509970,7cyclictest0-21swapper/321:32:543
127439976,1cyclictest61650irq/122-eno123:55:002
127439976,1cyclictest61650irq/122-eno121:30:132
127439976,1cyclictest61650irq/122-eno119:50:162
127439975,1cyclictest61650irq/122-eno122:45:002
127439975,1cyclictest61650irq/122-eno120:55:222
127439975,1cyclictest61650irq/122-eno119:25:222
127439975,1cyclictest61650irq/122-eno119:10:182
127439975,1cyclictest32389-21ntpq00:20:192
127439975,1cyclictest28-21ksoftirqd/223:40:002
127439975,1cyclictest28-21ksoftirqd/223:10:002
127439975,1cyclictest28-21ksoftirqd/222:05:012
127439975,1cyclictest28-21ksoftirqd/221:25:122
127439973,2cyclictest240-21systemd-journal20:45:012
127439971,6cyclictest0-21swapper/220:15:182
127439971,1cyclictest0-21swapper/222:10:192
127439970,1cyclictest0-21swapper/220:00:092
127349971,6cyclictest0-21swapper/122:48:551
127349971,6cyclictest0-21swapper/120:42:071
127349971,6cyclictest0-21swapper/120:31:551
127349971,2cyclictest0-21swapper/121:30:011
127349970,6cyclictest0-21swapper/123:35:181
127349970,1cyclictest0-21swapper/123:15:121
127349970,1cyclictest0-21swapper/121:18:181
127349970,1cyclictest0-21swapper/100:25:541
127349970,1cyclictest0-21swapper/100:23:121
127289976,1cyclictest9-21ksoftirqd/023:28:440
127289976,1cyclictest9-21ksoftirqd/021:45:240
127289976,1cyclictest9-21ksoftirqd/021:40:000
127289975,1cyclictest9-21ksoftirqd/020:20:000
127289975,1cyclictest707-21snmpd21:54:290
127289975,1cyclictest707-21snmpd20:57:390
127289975,1cyclictest707-21snmpd20:36:490
127289975,1cyclictest707-21snmpd19:37:450
127289975,1cyclictest707-21snmpd00:10:140
127289974,1cyclictest9-21ksoftirqd/023:45:220
127289974,1cyclictest548-21systemd-logind22:10:200
127289970,6cyclictest31989-21/usr/sbin/munin22:05:190
127289970,6cyclictest28488-21gltestperf19:40:150
127289970,6cyclictest21959-21ntpq22:50:170
127289970,6cyclictest15590-21cstates21:30:130
127289970,1cyclictest4999-21ls21:05:220
28804260,1sleep30-21swapper/321:55:203
127509965,1cyclictest9543-21apt-get20:10:163
127509965,1cyclictest707-21snmpd22:40:093
127509965,1cyclictest707-21snmpd22:39:423
127509965,1cyclictest707-21snmpd22:09:133
127509965,1cyclictest707-21snmpd21:41:243
127509965,1cyclictest707-21snmpd21:39:513
127509965,1cyclictest707-21snmpd19:26:533
127509964,1cyclictest707-21snmpd23:33:133
127509964,1cyclictest3692-21grep19:55:193
127509964,1cyclictest35-21ksoftirqd/323:58:203
127509964,1cyclictest35-21ksoftirqd/321:06:543
127509964,1cyclictest11134-21munin-run22:30:013
127509963,1cyclictest240-21systemd-journal19:15:003
127509962,3cyclictest15105-21munin-node21:27:553
127509962,2cyclictest240-21systemd-journal20:55:003
127509961,1cyclictest0-21swapper/319:30:123
127439966,0cyclictest61650irq/122-eno123:28:472
127439966,0cyclictest61650irq/122-eno123:10:202
127439966,0cyclictest61650irq/122-eno122:35:152
127439966,0cyclictest61650irq/122-eno122:32:182
127439966,0cyclictest61650irq/122-eno122:28:122
127439966,0cyclictest61650irq/122-eno122:21:352
127439966,0cyclictest61650irq/122-eno122:07:582
127439966,0cyclictest61650irq/122-eno121:50:152
127439966,0cyclictest61650irq/122-eno121:39:552
127439966,0cyclictest61650irq/122-eno119:40:102
127439966,0cyclictest61650irq/122-eno100:00:362
127439965,1cyclictest61650irq/122-eno123:30:172
127439965,1cyclictest61650irq/122-eno121:05:152
127439964,1cyclictest61650irq/122-eno123:15:152
127439964,1cyclictest61650irq/122-eno122:55:222
127439964,1cyclictest61650irq/122-eno122:15:182
127439964,1cyclictest61650irq/122-eno119:55:192
127439964,1cyclictest61650irq/122-eno100:05:142
127439963,2cyclictest28748-21apt-config20:50:012
127439962,2cyclictest1184-21apt-get00:25:142
127439961,3cyclictest0-21swapper/219:20:162
127439961,0cyclictest0-21swapper/221:10:132
127439960,6cyclictest0-21swapper/220:13:392
127439960,5cyclictest0-21swapper/221:04:352
127439960,5cyclictest0-21swapper/219:37:272
127439960,5cyclictest0-21swapper/200:15:292
127349961,5cyclictest0-21swapper/120:28:311
127349961,3cyclictest0-21swapper/121:20:111
127349961,3cyclictest0-21swapper/120:45:121
127349960,6cyclictest0-21swapper/123:27:221
127349960,6cyclictest0-21swapper/123:07:241
127349960,6cyclictest0-21swapper/122:16:081
127349960,6cyclictest0-21swapper/122:05:221
127349960,6cyclictest0-21swapper/121:59:251
127349960,6cyclictest0-21swapper/120:02:001
127349960,6cyclictest0-21swapper/119:17:221
127349960,5cyclictest0-21swapper/123:50:171
127349960,5cyclictest0-21swapper/120:10:201
127349960,4cyclictest0-21swapper/100:35:171
127349960,2cyclictest0-21swapper/100:30:191
127349960,1cyclictest0-21swapper/122:40:161
127349960,1cyclictest0-21swapper/122:27:351
127349960,1cyclictest0-21swapper/121:46:311
127349960,1cyclictest0-21swapper/100:12:271
127349960,0cyclictest0-21swapper/123:30:111
127289965,1cyclictest707-21snmpd22:59:360
127289965,1cyclictest707-21snmpd21:57:230
127289965,1cyclictest21572-21cat19:25:170
127289965,1cyclictest0-21swapper/020:10:170
127289964,1cyclictest9-21ksoftirqd/019:55:000
127289963,1cyclictest240-21systemd-journal00:00:000
127289961,3cyclictest20017-21cat21:40:000
127289961,1cyclictest1114-21/usr/sbin/munin21:00:220
127289960,6cyclictest0-21swapper/020:00:080
127289960,6cyclictest0-21swapper/019:56:080
127289960,5cyclictest14865-21ls20:20:130
127289960,5cyclictest0-21swapper/023:50:130
127289960,5cyclictest0-21swapper/023:00:120
127289960,5cyclictest0-21swapper/019:30:120
127289960,2cyclictest0-21swapper/023:33:270
127289960,0cyclictest0-21swapper/023:10:120
127289960,0cyclictest0-21swapper/020:45:160
127289960,0cyclictest0-21swapper/000:30:140
127289960,0cyclictest0-21swapper/000:09:060
127509955,0cyclictest27880-21apt-get23:05:113
127509955,0cyclictest0-21swapper/320:00:053
127509954,1cyclictest707-21snmpd22:13:343
127509954,1cyclictest707-21snmpd22:02:283
127509954,1cyclictest707-21snmpd20:55:083
127509954,1cyclictest707-21snmpd20:41:463
127509954,1cyclictest10508-21irqstats23:35:183
127509953,1cyclictest18844-21df19:20:143
127509952,2cyclictest26324-21apt-get00:10:143
127509952,1cyclictest240-21systemd-journal19:55:003
127509952,1cyclictest19333-21aten2.4-expect20:30:113
127509952,1cyclictest12290-21users21:20:203
127509951,2cyclictest1623-21df_inode21:00:143
127509951,1cyclictest30175-21apt-get19:45:123
127509950,5cyclictest0-21swapper/323:15:353
127509950,5cyclictest0-21swapper/323:10:253
127509950,4cyclictest14477-21apt-get20:20:113
127509950,3cyclictest240-21systemd-journal19:44:543
127509950,0cyclictest0-21swapper/321:13:493
127439955,0cyclictest61650irq/122-eno123:39:082
127439955,0cyclictest61650irq/122-eno121:20:142
127439955,0cyclictest61650irq/122-eno121:15:122
127439955,0cyclictest61650irq/122-eno100:30:122
127439953,1cyclictest61650irq/122-eno121:45:122
127439953,1cyclictest20868-21grep23:55:202
127439953,1cyclictest18482-21sed20:25:202
127439950,5cyclictest0-21swapper/219:15:202
127439950,2cyclictest240-21systemd-journal19:50:002
127439950,1cyclictest26833-21diskstats00:10:152
127349953,1cyclictest0-21swapper/119:10:161
127349951,4cyclictest0-21swapper/100:08:301
127349951,1cyclictest0-21swapper/121:30:211
127349951,1cyclictest0-21swapper/100:00:121
127349950,3cyclictest0-21swapper/121:10:141
127349950,3cyclictest0-21swapper/119:20:201
127349950,2cyclictest0-21swapper/100:15:131
127349950,1cyclictest0-21swapper/120:10:011
127289955,0cyclictest0-21swapper/021:23:330
127289954,1cyclictest9-21ksoftirqd/000:35:000
127289952,1cyclictest7181-21/usr/sbin/munin20:05:110
127289952,1cyclictest240-21systemd-journal23:17:000
127289951,3cyclictest32414-21ntp_states00:20:200
127289950,5cyclictest0-21swapper/022:20:120
127289950,4cyclictest9004-21/usr/sbin/munin22:25:170
127289950,0cyclictest0-21swapper/023:08:540
127289950,0cyclictest0-21swapper/020:41:270
127289950,0cyclictest0-21swapper/020:25:080
127289950,0cyclictest0-21swapper/019:10:120
127509944,0cyclictest707-21snmpd23:24:423
127509944,0cyclictest22938-21sensors20:35:213
127509944,0cyclictest0-21swapper/322:46:363
127509944,0cyclictest0-21swapper/322:21:583
127509943,1cyclictest26808-21/usr/sbin/munin19:35:203
127509943,1cyclictest25843-21cut21:50:163
127509943,1cyclictest12530-21expr20:15:163
127509943,0cyclictest12157-21seq23:40:003
127509942,1cyclictest8525-21sendmail_mailst20:05:193
127509942,1cyclictest17358-21grep20:25:143
127509941,1cyclictest240-21systemd-journal23:50:003
127509940,3cyclictest0-21swapper/300:25:143
127509940,1cyclictest0-21swapper/300:20:163
127509940,1cyclictest0-21swapper/300:00:123
127509940,0cyclictest0-21swapper/323:45:203
127349943,1cyclictest251272sleep122:58:201
127349943,1cyclictest0-21swapper/122:35:151
127349942,1cyclictest138512sleep120:15:261
127349941,2cyclictest0-21swapper/122:20:121
127349941,1cyclictest0-21swapper/119:39:591
127349940,4cyclictest0-21swapper/121:54:251
127349940,4cyclictest0-21swapper/119:50:001
127349940,4cyclictest0-21swapper/119:32:171
127349940,3cyclictest0-21swapper/121:05:001
127349940,2cyclictest0-21swapper/123:40:121
127349940,2cyclictest0-21swapper/122:10:141
127349940,2cyclictest0-21swapper/120:55:171
127349940,1cyclictest0-21swapper/123:25:001
127349940,1cyclictest0-21swapper/122:50:161
127349940,1cyclictest0-21swapper/122:05:001
127349940,1cyclictest0-21swapper/121:35:151
127349940,1cyclictest0-21swapper/119:55:151
127349940,1cyclictest0-21swapper/119:25:121
127349940,0cyclictest0-21swapper/123:00:191
127349940,0cyclictest0-21swapper/120:35:211
127349940,0cyclictest0-21swapper/120:24:111
127349931,1cyclictest0-21swapper/123:55:161
127349931,1cyclictest0-21swapper/123:45:141
127349931,1cyclictest0-21swapper/123:10:121
127349930,2cyclictest0-21swapper/121:40:001
127349930,1cyclictest0-21swapper/122:30:111
127349930,1cyclictest0-21swapper/120:50:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional