You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-25 - 07:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Sat Jan 25, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15177992927,1cyclictest303-21systemd-journal00:05:001
1517799290,28cyclictest0-21swapper/123:20:121
1517799290,1cyclictest25801-21sendmail-msp22:00:001
1517799290,0cyclictest0-21swapper/122:40:171
1517699290,28cyclictest3655-21apt-get23:50:090
1517699290,28cyclictest3374-21awk23:50:010
1517699290,1cyclictest8419-21apt-get00:00:150
1517699290,1cyclictest22159-21munin-run19:25:000
15182992828,0cyclictest21277-21apt-get20:30:163
15182992815,0cyclictest151rcu_preempt23:23:453
15178992828,0cyclictest0-21swapper/219:10:102
15178992826,1cyclictest626-21gdbus19:25:002
1517899280,27cyclictest18465-21apt-get21:40:122
1517899280,27cyclictest0-21swapper/219:30:182
1517899280,0cyclictest0-21swapper/222:10:072
1517899280,0cyclictest0-21swapper/221:15:102
15177992828,0cyclictest0-21swapper/119:30:161
15177992826,1cyclictest32544-21munin-run23:40:011
15177992826,1cyclictest0-21swapper/122:30:001
1517799280,28cyclictest0-21swapper/120:35:141
1517799280,27cyclictest0-21swapper/121:10:161
1517799280,0cyclictest0-21swapper/100:15:121
1517699280,28cyclictest0-21swapper/021:50:080
1517699280,0cyclictest0-21swapper/019:25:120
15182992727,0cyclictest20095-21apt-get19:20:143
15182992727,0cyclictest10823-21apt-get21:20:123
15182992725,1cyclictest27977-21idleruntime-cro20:45:003
15182992725,1cyclictest0-21swapper/300:40:013
1518299270,0cyclictest0-21swapper/300:10:083
15178992727,0cyclictest0-21swapper/223:15:122
15178992727,0cyclictest0-21swapper/220:35:142
15178992725,1cyclictest12001-21perf22:50:012
1517899270,27cyclictest0-21swapper/223:35:022
1517899270,0cyclictest0-21swapper/223:40:122
1517899270,0cyclictest0-21swapper/221:00:102
15177992727,0cyclictest0-21swapper/121:35:121
15176992727,0cyclictest0-21swapper/023:35:130
15176992727,0cyclictest0-21swapper/022:30:080
15176992727,0cyclictest0-21swapper/019:45:120
15176992727,0cyclictest0-21swapper/000:10:080
15176992725,1cyclictest10565-21munin-run21:20:010
15182992626,0cyclictest0-21swapper/323:35:143
15182992626,0cyclictest0-21swapper/322:30:083
15182992626,0cyclictest0-21swapper/320:55:153
15178992626,0cyclictest3779-21apt-get21:05:122
15177992626,0cyclictest0-21swapper/119:54:531
15177992625,1cyclictest20690-21perf20:30:001
15176992626,0cyclictest0-21swapper/022:35:110
15176992626,0cyclictest0-21swapper/020:55:150
15176992626,0cyclictest0-21swapper/019:35:100
15176992626,0cyclictest0-21swapper/000:35:130
15182992525,0cyclictest13734-21apt-get00:15:123
15182992525,0cyclictest0-21swapper/322:15:113
15182992525,0cyclictest0-21swapper/319:45:123
15178992525,0cyclictest13784-21apt-get21:30:082
15178992525,0cyclictest0-21swapper/200:00:002
15178992524,1cyclictest4308-21apt-get19:55:142
15178992524,1cyclictest11351-21apt-get20:10:182
15177992523,2cyclictest11980-21cron22:50:011
15177992523,1cyclictest0-21swapper/122:25:001
15176992525,0cyclictest0-21swapper/019:10:110
15182992423,1cyclictest28697-21grep20:50:003
15182992423,1cyclictest10510-21munin-run00:05:003
15178992424,0cyclictest0-21swapper/220:15:022
15176992424,0cyclictest29354-21apt-get22:10:070
15176992424,0cyclictest0-21swapper/021:20:120
15176992423,1cyclictest24570-21systemctl23:20:000
15182992323,0cyclictest0-21swapper/320:00:173
15178992323,0cyclictest1936-21apt-get19:50:142
15178992323,0cyclictest0-21swapper/222:20:162
15178992323,0cyclictest0-21swapper/219:35:102
15178992320,2cyclictest32520-21cron23:40:012
15177992323,0cyclictest0-21swapper/121:50:081
15177992323,0cyclictest0-21swapper/121:35:011
15182992222,0cyclictest8967-21apt-get20:05:103
15182992222,0cyclictest609-21dbus-daemon21:45:003
15182992222,0cyclictest26096-21apt-get22:00:133
15182992222,0cyclictest26096-21apt-get22:00:133
15182992222,0cyclictest0-21swapper/319:50:143
15182992221,1cyclictest18810-21munin-run00:30:023
15178992221,1cyclictest14636-21perf22:55:012
15178992220,1cyclictest0-21swapper/221:00:012
15177992222,0cyclictest0-21swapper/100:20:121
15177992222,0cyclictest0-21swapper/100:20:121
15177992220,2cyclictest0-21swapper/121:40:111
1517799220,21cyclictest0-21swapper/123:50:011
15176992222,0cyclictest0-21swapper/023:00:100
15176992222,0cyclictest0-21swapper/022:15:100
15182992121,0cyclictest29712-21apt-get19:40:173
15182992120,1cyclictest21421-21apt-get21:50:083
15182992119,1cyclictest609-21dbus-daemon22:10:013
15178992121,0cyclictest0-21swapper/223:10:082
15177992119,1cyclictest0-21swapper/122:15:011
15176992121,0cyclictest0-21swapper/020:10:170
15176992121,0cyclictest0-21swapper/019:15:120
15176992120,1cyclictest609-21dbus-daemon20:40:010
15182992020,0cyclictest16091-21apt-get00:20:133
15182992020,0cyclictest16091-21apt-get00:20:123
15182992020,0cyclictest0-21swapper/321:00:113
15182992018,1cyclictest6379-21perf20:00:003
15178992020,0cyclictest0-21swapper/223:20:132
15178992020,0cyclictest0-21swapper/222:40:102
15178992019,1cyclictest23752-21apt-get21:55:122
15176992020,0cyclictest0-21swapper/020:30:170
15176992020,0cyclictest0-21swapper/019:40:170
15182991919,0cyclictest0-21swapper/320:50:083
15182991919,0cyclictest0-21swapper/319:25:123
15178991919,0cyclictest0-21swapper/222:20:012
15176991919,0cyclictest0-21swapper/022:00:140
15176991919,0cyclictest0-21swapper/022:00:130
15176991919,0cyclictest0-21swapper/020:20:210
15178991818,0cyclictest0-21swapper/222:55:122
15177991818,0cyclictest0-21swapper/122:55:121
15177991817,1cyclictest0-21swapper/120:05:011
15177991816,1cyclictest8281-21munin-run00:00:011
15176991818,0cyclictest0-21swapper/020:00:170
15182991717,0cyclictest0-21swapper/321:30:083
15178991717,0cyclictest17243-21apt-get23:00:102
15178991715,1cyclictest0-21swapper/220:10:022
15177991713,3cyclictest0-21swapper/120:15:011
1517799170,0cyclictest0-21swapper/123:15:161
15176991717,0cyclictest0-21swapper/021:10:150
15176991717,0cyclictest0-21swapper/020:50:070
15182991616,0cyclictest0-21swapper/321:10:153
15182991614,1cyclictest2458-21perf23:45:023
15178991616,0cyclictest0-21swapper/222:30:082
15177991615,1cyclictest28151-21apt-get22:05:001
15177991615,1cyclictest28151-21apt-get22:05:001
15177991614,1cyclictest0-21swapper/119:30:011
1517799160,14cyclictest0-21swapper/119:55:511
1517799160,0cyclictest0-21swapper/123:50:111
1517799160,0cyclictest0-21swapper/120:55:151
1517799160,0cyclictest0-21swapper/119:49:391
15176991616,0cyclictest20528-21perf21:45:000
15176991616,0cyclictest0-21swapper/021:35:100
15176991614,1cyclictest0-21swapper/023:20:170
15176991614,1cyclictest0-21swapper/020:30:000
1517699160,15cyclictest29718-21awk23:30:160
15182991515,0cyclictest20201-21apt-get23:10:083
1518299150,15cyclictest0-21swapper/322:38:553
1518299150,14cyclictest331rcuc/320:20:183
1518299150,14cyclictest12396-21ntp_states20:10:223
1518299150,14cyclictest0-21swapper/319:35:013
15178991513,1cyclictest8167-21munin-run21:15:002
15178991512,2cyclictest18193-21perf21:40:002
15177991515,0cyclictest0-21swapper/123:05:011
15177991513,1cyclictest0-21swapper/119:20:161
1517799150,1cyclictest0-21swapper/122:30:131
1517799150,1cyclictest0-21swapper/120:40:141
1517799150,1cyclictest0-21swapper/100:35:171
1517799150,15cyclictest0-21swapper/121:25:031
1517799150,15cyclictest0-21swapper/119:35:191
1517799150,14cyclictest0-21swapper/120:15:301
1517799150,0cyclictest0-21swapper/122:08:251
1517799150,0cyclictest0-21swapper/120:05:401
1517799150,0cyclictest0-21swapper/100:34:571
15176991512,2cyclictest26813-21apt-get19:35:010
15182991414,0cyclictest12557-21apt-get22:50:093
1518299141,0cyclictest0-21swapper/300:30:533
1518299140,14cyclictest0-21swapper/323:56:333
1518299140,14cyclictest0-21swapper/323:50:553
1518299140,14cyclictest0-21swapper/323:46:093
1518299140,14cyclictest0-21swapper/323:25:463
1518299140,14cyclictest0-21swapper/323:05:233
1518299140,14cyclictest0-21swapper/322:55:153
1518299140,14cyclictest0-21swapper/322:42:173
1518299140,14cyclictest0-21swapper/322:27:203
1518299140,14cyclictest0-21swapper/322:21:293
1518299140,14cyclictest0-21swapper/322:11:453
1518299140,14cyclictest0-21swapper/321:49:333
1518299140,14cyclictest0-21swapper/321:36:363
1518299140,14cyclictest0-21swapper/321:25:543
1518299140,14cyclictest0-21swapper/320:25:023
1518299140,14cyclictest0-21swapper/320:15:153
1518299140,14cyclictest0-21swapper/319:15:493
1518299140,14cyclictest0-21swapper/319:12:103
1518299140,10cyclictest0-21swapper/323:01:193
1518299140,10cyclictest0-21swapper/320:35:483
1518299140,10cyclictest0-21swapper/300:08:323
1518299140,0cyclictest0-21swapper/323:30:423
1518299140,0cyclictest0-21swapper/323:18:283
1518299140,0cyclictest0-21swapper/322:45:323
1518299140,0cyclictest0-21swapper/321:55:213
1518299140,0cyclictest0-21swapper/321:17:283
1518299140,0cyclictest0-21swapper/321:05:113
1518299140,0cyclictest0-21swapper/319:35:073
15178991414,0cyclictest0-21swapper/219:27:182
1517899140,7cyclictest0-21swapper/200:20:132
1517899140,7cyclictest0-21swapper/200:20:122
1517899140,14cyclictest0-21swapper/223:50:092
1517899140,14cyclictest0-21swapper/223:46:472
1517899140,14cyclictest0-21swapper/223:25:052
1517899140,14cyclictest0-21swapper/223:08:412
1517899140,14cyclictest0-21swapper/222:36:372
1517899140,14cyclictest0-21swapper/222:25:252
1517899140,14cyclictest0-21swapper/222:06:062
1517899140,14cyclictest0-21swapper/221:52:062
1517899140,14cyclictest0-21swapper/221:47:092
1517899140,14cyclictest0-21swapper/221:25:012
1517899140,14cyclictest0-21swapper/221:21:142
1517899140,14cyclictest0-21swapper/220:51:032
1517899140,14cyclictest0-21swapper/220:45:152
1517899140,14cyclictest0-21swapper/220:40:542
1517899140,14cyclictest0-21swapper/220:30:082
1517899140,14cyclictest0-21swapper/220:26:462
1517899140,14cyclictest0-21swapper/220:21:482
1517899140,14cyclictest0-21swapper/220:01:492
1517899140,14cyclictest0-21swapper/219:45:342
1517899140,14cyclictest0-21swapper/219:40:472
1517899140,14cyclictest0-21swapper/219:15:432
1517899140,14cyclictest0-21swapper/200:36:532
1517899140,14cyclictest0-21swapper/200:27:532
1517899140,14cyclictest0-21swapper/200:16:512
1517899140,14cyclictest0-21swapper/200:01:022
1517899140,0cyclictest0-21swapper/200:14:102
1517899140,0cyclictest0-21swapper/200:06:542
15177991414,0cyclictest0-21swapper/123:40:371
15177991414,0cyclictest0-21swapper/122:35:021
15177991414,0cyclictest0-21swapper/121:20:131
15177991414,0cyclictest0-21swapper/120:30:011
15177991414,0cyclictest0-21swapper/119:11:221
15177991414,0cyclictest0-21swapper/100:10:101
15177991414,0cyclictest0-21swapper/100:05:501
15177991413,1cyclictest0-21swapper/121:00:181
15177991412,1cyclictest0-21swapper/123:30:161
1517799140,14cyclictest0-21swapper/123:25:451
1517799140,14cyclictest0-21swapper/122:50:281
1517799140,14cyclictest0-21swapper/122:16:501
1517799140,14cyclictest0-21swapper/121:46:131
1517799140,14cyclictest0-21swapper/121:15:181
1517799140,14cyclictest0-21swapper/120:52:101
1517799140,14cyclictest0-21swapper/120:45:511
1517799140,14cyclictest0-21swapper/120:21:071
1517799140,14cyclictest0-21swapper/119:40:051
1517799140,14cyclictest0-21swapper/119:16:351
1517799140,0cyclictest0-21swapper/123:13:131
1517799140,0cyclictest0-21swapper/123:07:141
1517799140,0cyclictest0-21swapper/121:07:321
1517799140,0cyclictest0-21swapper/100:27:481
15176991414,0cyclictest0-21swapper/023:25:180
15176991414,0cyclictest0-21swapper/020:40:110
15176991412,1cyclictest0-21swapper/023:40:170
1517699140,14cyclictest0-21swapper/023:11:090
1517699140,14cyclictest0-21swapper/022:58:410
1517699140,14cyclictest0-21swapper/022:52:400
1517699140,14cyclictest0-21swapper/022:46:200
1517699140,14cyclictest0-21swapper/022:40:340
1517699140,14cyclictest0-21swapper/021:55:450
1517699140,14cyclictest0-21swapper/021:45:020
1517699140,14cyclictest0-21swapper/021:01:460
1517699140,14cyclictest0-21swapper/020:05:300
1517699140,14cyclictest0-21swapper/019:51:190
1517699140,14cyclictest0-21swapper/000:30:040
1517699140,14cyclictest0-21swapper/000:25:040
1517699140,14cyclictest0-21swapper/000:20:440
1517699140,14cyclictest0-21swapper/000:20:440
1517699140,14cyclictest0-21swapper/000:16:590
1517699140,14cyclictest0-21swapper/000:07:310
1517699140,0cyclictest0-21swapper/023:55:560
1517699140,0cyclictest0-21swapper/023:07:450
1517699140,0cyclictest0-21swapper/022:25:220
1517699140,0cyclictest0-21swapper/022:05:270
1517699140,0cyclictest0-21swapper/021:30:450
1517699140,0cyclictest0-21swapper/021:25:120
1517699140,0cyclictest0-21swapper/021:06:280
1517699140,0cyclictest0-21swapper/020:45:250
1517699140,0cyclictest0-21swapper/020:15:150
1517699140,0cyclictest0-21swapper/019:55:340
15178991313,0cyclictest0-21swapper/200:30:082
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional