You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-02 - 06:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Wed Jul 02, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
293172940,0sleep00-21swapper/022:58:200
96242750,0sleep2311rcuc/222:59:342
70902600,0sleep20-21swapper/223:08:282
87052590,0sleep00-21swapper/023:54:120
315272590,1sleep131526-21sshd23:47:081
195132590,0sleep30-21swapper/323:21:423
49972580,0sleep00-21swapper/022:01:050
293562580,0sleep20-21swapper/221:24:022
277062580,1sleep227704-21lspci22:30:392
30742570,0sleep20-21swapper/200:25:542
16972570,0sleep0111rcuc/019:30:160
160882570,1sleep316086-21lspci23:03:123
240652560,1sleep3646-21dbus-daemon23:19:113
159752560,0sleep10-21swapper/122:32:381
39102550,1sleep23907-21lspci22:07:072
300962550,0sleep30-21swapper/321:36:083
276352550,1sleep0646-21dbus-daemon23:22:270
70462540,0sleep20-21swapper/200:36:272
65152540,0sleep16503-21sshd21:40:031
303602540,0sleep00-21swapper/022:34:010
62352520,0sleep10-21swapper/123:50:481
226912510,1sleep2646-21dbus-daemon00:20:572
193572510,0sleep00-21swapper/023:18:430
26202500,0sleep32618-21sshd23:26:073
150442500,0sleep10-21swapper/123:03:061
130842500,0sleep00-21swapper/022:38:260
130842500,0sleep00-21swapper/022:38:260
20902490,0sleep10-21swapper/123:29:091
307962480,0sleep00-21swapper/021:39:180
294172480,0sleep329414-21bash21:57:193
317252470,0sleep10-21swapper/120:45:001
300222470,0sleep30-21swapper/300:15:013
300222470,0sleep30-21swapper/300:15:013
176052460,0sleep30-21swapper/300:34:203
111462440,0sleep20-21swapper/221:28:222
209542430,2sleep12469599cyclictest22:08:471
270132380,1sleep327007-21bash23:31:283
219462380,0sleep10-21swapper/122:57:371
39522360,0sleep30-21swapper/321:54:553
244722319,6sleep20-21swapper/219:08:372
2431323018,7sleep10-21swapper/119:06:391
243742297,7sleep30-21swapper/319:07:213
242262287,7sleep00-21swapper/019:05:340
16332220,0sleep20-21swapper/221:45:332
103512190,1sleep3646-21dbus-daemon21:13:093
54012180,0sleep00-21swapper/000:29:440
23412160,1sleep32339-21lspci23:53:353
91722150,1sleep29150-21kworker/2:319:50:002
2469599153,11cyclictest646-21dbus-daemon00:01:581
206142150,0sleep20-21swapper/221:38:202
152782150,0sleep30-21swapper/323:57:513
94122140,0sleep19352-21sshd22:25:531
25372140,0sleep00-21swapper/022:52:440
2469699140,13cyclictest646-21dbus-daemon21:52:392
24695991412,1cyclictest12243-21lspci22:20:081
2469199144,2cyclictest9-21ksoftirqd/021:46:300
160732140,1sleep216070-21sshd22:50:532
48702130,0sleep24873-21bash00:06:032
2469699130,12cyclictest29577-21sshd22:49:102
2469199134,2cyclictest9-21ksoftirqd/021:13:180
2469199130,1cyclictest11386-21sshd22:20:030
241512130,0sleep2311rcuc/221:44:442
188662130,0sleep00-21swapper/023:06:290
90362120,0sleep00-21swapper/023:41:580
24697991210,1cyclictest32624-21sshd00:02:323
24697991210,1cyclictest19284-21bash22:20:423
2469799120,1cyclictest24932-21unixbench_multi20:25:223
24696991210,1cyclictest1633-21lspci23:17:002
24696991210,1cyclictest1-21systemd23:31:402
2469699120,1cyclictest2767-21bash23:23:102
24695991210,1cyclictest29914-21lspci21:20:581
24695991210,1cyclictest29240-21bash22:45:581
24695991210,1cyclictest0-21swapper/121:15:281
2469599120,11cyclictest10768-21sshd00:09:581
2469599120,11cyclictest0-21swapper/100:27:481
2469199124,4cyclictest15246-21munin-run20:05:000
2469199124,2cyclictest9-21ksoftirqd/022:09:490
2469199124,1cyclictest9-21ksoftirqd/023:12:510
2469199124,1cyclictest9-21ksoftirqd/022:13:290
2469199124,1cyclictest9-21ksoftirqd/000:09:270
2469199123,2cyclictest9-21ksoftirqd/023:27:140
2469199123,2cyclictest9-21ksoftirqd/022:17:040
2469199122,2cyclictest18151-21bash23:45:490
24691991210,1cyclictest0-21swapper/022:45:530
2469199120,1cyclictest3875-21lspci23:56:440
2469199120,11cyclictest26847-21bash23:34:330
2469199120,11cyclictest26743-21lspci00:35:140
236632120,0sleep30-21swapper/322:57:473
192342120,0sleep30-21swapper/322:08:373
108852120,0sleep10-21swapper/123:20:521
2469799119,1cyclictest620-13audispd22:41:223
2469799119,1cyclictest29025-21id22:15:323
2469799110,10cyclictest0-21swapper/300:26:023
2469699119,1cyclictest26369-21bash21:17:392
24696991110,0cyclictest0-21swapper/222:38:502
24696991110,0cyclictest0-21swapper/222:38:502
24696991110,0cyclictest0-21swapper/221:08:592
2469699110,10cyclictest0-21swapper/223:45:502
2469699110,10cyclictest0-21swapper/223:43:002
2469699110,10cyclictest0-21swapper/200:02:202
2469699110,0cyclictest0-21swapper/200:13:102
2469599119,1cyclictest646-21dbus-daemon22:40:481
24695991110,0cyclictest0-21swapper/121:34:181
2469599110,10cyclictest0-21swapper/122:12:381
2469599110,10cyclictest0-21swapper/121:54:081
2469599110,10cyclictest0-21swapper/119:10:281
2469599110,10cyclictest0-21swapper/100:32:281
2469599110,10cyclictest0-21swapper/100:15:081
2469599110,10cyclictest0-21swapper/100:15:081
2469599110,0cyclictest0-21swapper/123:56:181
2469199114,1cyclictest9-21ksoftirqd/021:20:280
2469199114,1cyclictest9-21ksoftirqd/000:30:510
2469199114,1cyclictest9-21ksoftirqd/000:10:030
2469199113,2cyclictest9-21ksoftirqd/022:40:100
2469199113,2cyclictest9-21ksoftirqd/021:59:010
2469199113,2cyclictest9-21ksoftirqd/021:44:430
2469199113,2cyclictest9-21ksoftirqd/000:03:580
2469199113,1cyclictest9-21ksoftirqd/023:04:160
2469199111,1cyclictest9-21ksoftirqd/021:25:560
2469199110,10cyclictest0-21swapper/021:18:330
2469199110,10cyclictest0-21swapper/019:10:230
2469799109,0cyclictest0-21swapper/323:48:523
2469799109,0cyclictest0-21swapper/323:13:523
2469799109,0cyclictest0-21swapper/322:46:323
2469799109,0cyclictest0-21swapper/320:45:223
2469799109,0cyclictest0-21swapper/300:20:523
2469799100,0cyclictest0-21swapper/321:25:123
2469799100,0cyclictest0-21swapper/319:20:023
2469799100,0cyclictest0-21swapper/300:35:223
2469799100,0cyclictest0-21swapper/300:13:223
2469699109,0cyclictest0-21swapper/223:59:312
2469699109,0cyclictest0-21swapper/223:37:202
2469699109,0cyclictest0-21swapper/223:10:502
2469699109,0cyclictest0-21swapper/221:32:492
2469699100,9cyclictest0-21swapper/219:23:492
2469699100,0cyclictest0-21swapper/223:04:402
2469599109,0cyclictest0-21swapper/100:22:381
2469599100,9cyclictest0-21swapper/100:38:591
2469599100,0cyclictest0-21swapper/123:13:181
2469599100,0cyclictest0-21swapper/122:51:081
2469599100,0cyclictest0-21swapper/122:00:081
2469199102,1cyclictest9-21ksoftirqd/021:51:140
2469199101,2cyclictest9-21ksoftirqd/022:26:330
2469199101,2cyclictest9-21ksoftirqd/000:20:160
2469199100,1cyclictest9-21ksoftirqd/023:37:070
2469199100,1cyclictest0-21swapper/021:31:040
2469199100,1cyclictest0-21swapper/000:15:170
2469199100,1cyclictest0-21swapper/000:15:170
246979998,0cyclictest0-21swapper/321:00:223
246979998,0cyclictest0-21swapper/320:55:123
246979998,0cyclictest0-21swapper/319:40:223
246979996,2cyclictest649-21avahi-daemon22:28:053
246969998,0cyclictest0-21swapper/223:28:502
246969998,0cyclictest0-21swapper/222:25:402
246969998,0cyclictest0-21swapper/222:18:102
246969998,0cyclictest0-21swapper/220:05:492
246969990,0cyclictest0-21swapper/220:20:492
246969990,0cyclictest0-21swapper/219:25:492
246959998,0cyclictest0-21swapper/120:45:481
246959998,0cyclictest0-21swapper/120:02:481
246959998,0cyclictest0-21swapper/119:46:581
246959990,8cyclictest2883-21sshd22:19:151
246979987,0cyclictest0-21swapper/321:08:423
246979986,1cyclictest6507-21lspci21:15:453
246979986,1cyclictest24984-21lspci22:51:453
246979986,1cyclictest16277-21lspci23:39:393
246979985,2cyclictest649-21avahi-daemon22:30:273
246979985,2cyclictest649-21avahi-daemon22:03:023
246979985,2cyclictest649-21avahi-daemon21:45:433
246979985,2cyclictest646-21dbus-daemon21:32:183
246969987,0cyclictest0-21swapper/220:50:192
246969987,0cyclictest0-21swapper/219:30:192
246969987,0cyclictest0-21swapper/200:15:312
246969987,0cyclictest0-21swapper/200:15:302
246969986,1cyclictest33-21ksoftirqd/222:02:192
246969986,1cyclictest2054-21lspci22:43:272
246969986,1cyclictest1315-21sshd22:13:002
246969986,1cyclictest11195-21lspci00:30:162
246969985,2cyclictest649-21avahi-daemon21:10:422
246959987,0cyclictest0-21swapper/121:55:581
246959986,1cyclictest411-21lspci21:12:091
246959986,1cyclictest28492-21lspci23:43:501
246959986,1cyclictest23210-21lspci22:36:181
246959986,1cyclictest23210-21lspci22:36:181
246959986,1cyclictest10322-21lspci23:08:471
246959985,2cyclictest700-21gdbus21:28:541
246959985,2cyclictest649-21avahi-daemon21:45:181
246959984,3cyclictest23803-21sshd00:14:251
246919982,1cyclictest9-21ksoftirqd/021:09:060
246979976,0cyclictest0-21swapper/323:40:223
246979975,1cyclictest684-21polkitd21:41:273
246979975,1cyclictest41-21ksoftirqd/321:22:463
246979974,2cyclictest700-21gdbus23:05:093
246979974,2cyclictest700-21gdbus22:35:483
246979974,2cyclictest700-21gdbus22:35:483
246979973,3cyclictest646-21dbus-daemon00:05:403
246979972,4cyclictest616-13auditd22:13:343
246969975,1cyclictest649-21avahi-daemon23:51:592
246969975,1cyclictest646-21dbus-daemon21:58:132
246969975,1cyclictest29777-21lspci22:21:432
246959976,0cyclictest0-21swapper/121:36:081
246959975,1cyclictest646-21dbus-daemon23:30:181
246959974,2cyclictest649-21avahi-daemon23:37:031
246959974,2cyclictest649-21avahi-daemon23:15:421
246959970,6cyclictest0-21swapper/120:50:281
22597270,0sleep10-21swapper/120:20:181
246979964,1cyclictest17299-21snmpd19:30:003
246979963,2cyclictest17299-21snmpd19:47:583
246979960,5cyclictest0-21swapper/320:36:023
246979960,5cyclictest0-21swapper/319:12:023
246969963,2cyclictest1058-21sendmail19:55:162
246969960,5cyclictest0-21swapper/220:10:392
246959964,1cyclictest684-21polkitd21:07:371
246959963,2cyclictest17299-21snmpd20:25:171
246959960,5cyclictest0-21swapper/119:33:481
246959960,1cyclictest21355-21grep20:20:001
246919965,0cyclictest0-21swapper/020:50:130
246919964,1cyclictest3574-21cut20:55:120
246919964,1cyclictest21341-21idleruntime-cro20:20:000
246919963,2cyclictest17299-21snmpd19:57:220
246919961,3cyclictest9-21ksoftirqd/020:38:120
246919961,3cyclictest9-21ksoftirqd/020:20:130
246919961,3cyclictest9-21ksoftirqd/019:45:160
246919961,3cyclictest9-21ksoftirqd/019:35:140
246919961,3cyclictest0-21swapper/019:27:320
246919961,2cyclictest0-21swapper/020:33:590
246919960,3cyclictest0-21swapper/019:40:200
246979954,0cyclictest0-21swapper/320:10:523
246979954,0cyclictest0-21swapper/319:25:023
246979953,1cyclictest17299-21snmpd20:50:573
246979953,1cyclictest17299-21snmpd20:30:293
246979953,1cyclictest17299-21snmpd20:16:233
246979953,1cyclictest17299-21snmpd20:07:223
246979953,1cyclictest17299-21snmpd20:00:223
246979953,1cyclictest17299-21snmpd19:58:013
246979953,1cyclictest17299-21snmpd19:52:073
246979953,1cyclictest17299-21snmpd19:37:453
246979953,1cyclictest17299-21snmpd19:16:063
246979953,1cyclictest1058-21sendmail20:20:093
246979950,0cyclictest0-21swapper/320:40:423
246969954,0cyclictest0-21swapper/220:55:292
246969953,1cyclictest25368-21cat19:10:152
246969953,1cyclictest20283-21cut20:15:162
246969953,1cyclictest17299-21snmpd21:00:182
246969953,1cyclictest17299-21snmpd20:47:262
246969953,1cyclictest17299-21snmpd20:37:532
246969953,1cyclictest17299-21snmpd20:31:352
246969953,1cyclictest17299-21snmpd20:25:052
246969953,1cyclictest17299-21snmpd19:51:282
246969953,1cyclictest17299-21snmpd19:42:552
246969953,1cyclictest17299-21snmpd19:37:122
246969953,1cyclictest13437-21/usr/sbin/munin20:00:232
246969950,0cyclictest0-21swapper/220:40:292
246959954,0cyclictest0-21swapper/120:55:081
246959954,0cyclictest0-21swapper/120:06:381
246959954,0cyclictest0-21swapper/119:51:481
246959953,1cyclictest5788-21df_inode21:00:131
246959953,1cyclictest17299-21snmpd20:31:411
246959953,1cyclictest17299-21snmpd20:10:101
246959953,1cyclictest17299-21snmpd19:55:011
246959953,1cyclictest17299-21snmpd19:40:031
246959953,1cyclictest17299-21snmpd19:27:301
246959953,1cyclictest17299-21snmpd19:20:181
246959952,2cyclictest4765-21sshd19:36:371
246959952,2cyclictest27277-21sort19:15:011
246959952,2cyclictest17299-21snmpd20:35:441
246919953,1cyclictest17969-21cat20:10:160
246919953,1cyclictest17299-21snmpd20:06:280
246919951,2cyclictest9-21ksoftirqd/020:25:160
246919951,2cyclictest9-21ksoftirqd/019:50:120
246919951,1cyclictest0-21swapper/019:15:040
246919950,3cyclictest9-21ksoftirqd/021:00:150
246919950,3cyclictest9-21ksoftirqd/020:40:130
246919950,3cyclictest0-21swapper/020:45:130
246919950,2cyclictest0-21swapper/019:20:170
246969942,1cyclictest27729-21/usr/sbin/munin19:15:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional