You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 10:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Sun Nov 23, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11328993736,1cyclictest28-21ksoftirqd/200:40:002
1132399330,1cyclictest24106-21apt-get20:45:130
1132999310,30cyclictest0-21swapper/300:05:123
1132999300,29cyclictest9509-21idleruntime-cro23:40:013
11327993028,1cyclictest303-21systemd-journal00:35:011
11327993028,1cyclictest0-21swapper/122:55:011
1132999290,28cyclictest3693-21apt-get21:10:123
1132999290,28cyclictest22341-21apt-get21:50:133
1132999290,28cyclictest0-21swapper/323:15:133
1132999290,28cyclictest0-21swapper/321:00:123
1132999290,28cyclictest0-21swapper/320:00:143
1132999290,28cyclictest0-21swapper/319:35:133
1132999290,0cyclictest0-21swapper/300:15:133
11328992928,1cyclictest28-21ksoftirqd/220:00:002
11328992925,4cyclictest28-21ksoftirqd/221:45:132
1132799290,28cyclictest11250-21apt-get22:35:131
11323992928,1cyclictest19829-21apt-get00:00:160
1132399290,1cyclictest9846-21perf20:15:020
1132399290,1cyclictest30278-21cron19:50:010
1132399290,1cyclictest10953-21cron22:35:010
11329992828,0cyclictest0-21swapper/320:40:133
11329992827,0cyclictest0-21swapper/322:00:113
1132999280,28cyclictest0-21swapper/321:25:143
1132999280,27cyclictest0-21swapper/323:20:123
1132999280,27cyclictest0-21swapper/322:45:123
11328992828,0cyclictest0-21swapper/200:30:142
11328992827,1cyclictest0-21swapper/219:45:022
11328992826,1cyclictest303-21systemd-journal20:25:002
1132899280,28cyclictest0-21swapper/221:55:132
1132899280,28cyclictest0-21swapper/220:30:122
1132899280,27cyclictest2803-21apt-get23:25:142
11327992828,0cyclictest0-21swapper/123:45:131
1132799280,28cyclictest0-21swapper/119:30:151
1132799280,27cyclictest0-21swapper/121:40:141
1132799280,0cyclictest771-21apt-get19:55:151
11323992828,0cyclictest21783-21apt-get20:40:130
11323992828,0cyclictest0-21swapper/019:25:150
11329992727,0cyclictest12133-21apt-get23:45:143
11329992727,0cyclictest0-21swapper/323:50:123
11328992727,0cyclictest16224-21apt-get22:45:122
11328992727,0cyclictest0-21swapper/223:05:122
11328992727,0cyclictest0-21swapper/221:10:122
11328992727,0cyclictest0-21swapper/219:25:142
11328992726,1cyclictest609-21dbus-daemon22:20:012
1132899270,27cyclictest0-21swapper/222:35:142
1132899270,0cyclictest0-21swapper/223:35:122
1132899270,0cyclictest0-21swapper/221:40:132
1132899270,0cyclictest0-21swapper/219:40:152
11327992727,0cyclictest3790-21apt-get00:35:141
11327992727,0cyclictest13900-21apt-get22:40:121
11327992727,0cyclictest0-21swapper/121:10:121
11327992727,0cyclictest0-21swapper/120:15:151
1132799270,27cyclictest0-21swapper/123:10:131
1132799270,27cyclictest0-21swapper/120:10:141
1132799270,0cyclictest0-21swapper/121:30:101
11323992727,0cyclictest0-21swapper/023:40:010
11323992727,0cyclictest0-21swapper/022:40:020
11323992727,0cyclictest0-21swapper/021:35:160
11323992727,0cyclictest0-21swapper/021:05:130
11323992726,1cyclictest0-21swapper/000:10:120
11329992625,1cyclictest0-21swapper/319:30:013
11327992626,0cyclictest0-21swapper/100:20:151
11323992626,0cyclictest0-21swapper/021:55:130
11323992626,0cyclictest0-21swapper/020:05:140
11323992626,0cyclictest0-21swapper/019:40:140
11329992525,0cyclictest0-21swapper/323:00:113
11329992525,0cyclictest0-21swapper/322:50:143
11329992525,0cyclictest0-21swapper/320:50:013
11329992524,1cyclictest5457-21apt-get20:05:133
11328992525,0cyclictest0-21swapper/221:30:112
11328992525,0cyclictest0-21swapper/220:55:132
11328992525,0cyclictest0-21swapper/220:35:132
11328992525,0cyclictest0-21swapper/220:15:152
11327992525,0cyclictest17386-21apt-get23:55:151
11327992525,0cyclictest0-21swapper/120:55:131
11323992525,0cyclictest0-21swapper/000:20:160
11323992525,0cyclictest0-21swapper/000:05:110
11323992524,0cyclictest0-21swapper/020:24:590
11323992522,3cyclictest0-21swapper/020:50:120
11329992423,1cyclictest12184-21perf20:20:013
11328992424,0cyclictest8921-21apt-get22:30:122
11328992423,1cyclictest1354-21apt-get21:05:132
11327992424,0cyclictest19435-21apt-get20:35:121
11327992424,0cyclictest18575-21apt-get19:25:141
11323992423,1cyclictest17696-21apt-get21:40:140
11323992422,1cyclictest0-21swapper/000:35:010
11329992323,0cyclictest1452-21apt-get00:30:143
11329992323,0cyclictest0-21swapper/320:20:153
11328992323,0cyclictest20902-21apt-get19:30:142
11328992323,0cyclictest0-21swapper/220:10:142
11328992323,0cyclictest0-21swapper/220:05:142
11327992323,0cyclictest0-21swapper/100:10:131
11323992323,0cyclictest0-21swapper/019:55:150
11329992222,0cyclictest0-21swapper/323:25:023
11329992222,0cyclictest0-21swapper/322:05:103
11329992222,0cyclictest0-21swapper/321:15:143
11329992220,1cyclictest18317-21munin-run19:25:003
11328992221,1cyclictest0-21swapper/219:25:012
11328992220,1cyclictest8050-21cron21:20:002
11328992220,1cyclictest16822-21apt-get23:55:022
11327992222,0cyclictest0-21swapper/122:45:121
11323992222,0cyclictest0-21swapper/022:35:140
1132399220,7cyclictest0-21swapper/021:25:140
11329992121,0cyclictest0-21swapper/300:15:023
11328992120,1cyclictest24558-21apt-get00:10:132
11327992121,0cyclictest0-21swapper/121:35:161
11327992121,0cyclictest0-21swapper/120:30:111
11327992121,0cyclictest0-21swapper/120:05:141
11327992121,0cyclictest0-21swapper/119:40:151
11323992121,0cyclictest0-21swapper/021:50:120
11329992020,0cyclictest0-21swapper/323:30:123
11329992019,1cyclictest0-21swapper/321:25:003
11328992020,0cyclictest22182-21apt-get00:05:122
11323992020,0cyclictest16224-21apt-get22:45:120
11323992020,0cyclictest0-21swapper/020:55:130
11323992020,0cyclictest0-21swapper/020:30:120
11328991919,0cyclictest0-21swapper/223:20:122
11328991919,0cyclictest0-21swapper/220:45:132
11327991919,0cyclictest24667-21apt-get21:55:131
11327991919,0cyclictest0-21swapper/123:50:121
11327991919,0cyclictest0-21swapper/123:35:111
11327991919,0cyclictest0-21swapper/123:25:141
11327991916,2cyclictest303-21systemd-journal22:20:011
11323991919,0cyclictest10106-21apt-get20:15:140
11323991919,0cyclictest0-21swapper/021:30:110
11329991818,0cyclictest0-21swapper/322:55:133
11329991818,0cyclictest0-21swapper/300:00:153
11327991818,0cyclictest25543-21apt-get23:05:121
11327991818,0cyclictest0-21swapper/119:45:011
11327991816,1cyclictest14499-21sh20:25:001
11323991818,0cyclictest0-21swapper/022:10:120
11323991816,1cyclictest32636-21perf19:55:010
1132999170,13cyclictest0-21swapper/320:31:403
1132999170,13cyclictest0-21swapper/319:13:173
11328991717,0cyclictest0-21swapper/223:00:012
11328991717,0cyclictest0-21swapper/219:50:132
11323991717,0cyclictest0-21swapper/022:55:130
11323991717,0cyclictest0-21swapper/021:10:120
1132399170,16cyclictest0-21swapper/021:00:210
11329991616,0cyclictest0-21swapper/321:45:143
1132999160,15cyclictest27706-21latency_hist19:45:013
11328991616,0cyclictest14756-21apt-get23:50:112
11328991616,0cyclictest10831-21kworker/2:121:36:332
11328991614,1cyclictest29987-21munin-run23:15:012
1132899160,15cyclictest20231-21cstates00:00:162
1132799160,15cyclictest5643-21fschecks_time23:30:141
11323991616,0cyclictest0-21swapper/021:45:130
1132399160,0cyclictest0-21swapper/023:52:080
11329991514,1cyclictest0-21swapper/321:06:303
11329991514,1cyclictest0-21swapper/320:45:193
11329991512,2cyclictest29863-21tail00:20:183
1132999150,1cyclictest0-21swapper/322:10:133
1132999150,14cyclictest2433-21users19:55:253
1132999150,14cyclictest0-21swapper/320:35:203
11328991515,0cyclictest3967-21apt-get22:20:132
11328991515,0cyclictest29232-21apt-get00:20:162
11328991515,0cyclictest28-21ksoftirqd/223:42:362
11328991515,0cyclictest0-21swapper/223:45:132
1132899150,1cyclictest0-21swapper/221:00:162
11327991515,0cyclictest0-21swapper/122:30:111
11327991513,1cyclictest32186-21grep00:25:151
11327991513,1cyclictest21064-21ntp_states21:45:191
1132799150,1cyclictest29263-21munin-run22:05:011
1132799150,14cyclictest14325-21diskstats19:15:141
1132799150,14cyclictest0-21swapper/121:20:151
1132799150,14cyclictest0-21swapper/100:00:161
11323991514,1cyclictest0-21swapper/021:21:220
1132399150,1cyclictest13774-21wc19:15:010
1132399150,1cyclictest0-21swapper/023:15:180
1132399150,15cyclictest19935-21threads22:50:230
1132399150,15cyclictest0-21swapper/023:33:040
1132399150,15cyclictest0-21swapper/023:23:080
1132399150,15cyclictest0-21swapper/023:02:060
1132399150,0cyclictest0-21swapper/023:42:100
1132399150,0cyclictest0-21swapper/020:35:550
11329991414,0cyclictest0-21swapper/320:56:223
11329991414,0cyclictest0-21swapper/319:16:363
1132999140,14cyclictest0-21swapper/323:57:313
1132999140,14cyclictest0-21swapper/323:40:413
1132999140,14cyclictest0-21swapper/323:11:103
1132999140,14cyclictest0-21swapper/322:41:363
1132999140,14cyclictest0-21swapper/322:38:103
1132999140,14cyclictest0-21swapper/322:31:353
1132999140,14cyclictest0-21swapper/322:28:073
1132999140,14cyclictest0-21swapper/322:20:543
1132999140,14cyclictest0-21swapper/321:56:333
1132999140,14cyclictest0-21swapper/321:40:113
1132999140,14cyclictest0-21swapper/321:31:263
1132999140,14cyclictest0-21swapper/320:25:503
1132999140,14cyclictest0-21swapper/320:13:323
1132999140,14cyclictest0-21swapper/319:50:013
1132999140,14cyclictest0-21swapper/319:45:343
1132999140,14cyclictest0-21swapper/319:32:233
1132999140,14cyclictest0-21swapper/300:26:553
1132999140,0cyclictest0-21swapper/323:06:073
1132999140,0cyclictest0-21swapper/322:15:373
1132999140,0cyclictest0-21swapper/321:35:373
11328991414,0cyclictest0-21swapper/200:26:592
1132899140,14cyclictest0-21swapper/223:15:032
1132899140,14cyclictest0-21swapper/223:01:392
1132899140,14cyclictest0-21swapper/222:52:402
1132899140,14cyclictest0-21swapper/222:40:032
1132899140,14cyclictest0-21swapper/222:25:552
1132899140,14cyclictest0-21swapper/222:10:342
1132899140,14cyclictest0-21swapper/222:07:002
1132899140,14cyclictest0-21swapper/222:01:212
1132899140,14cyclictest0-21swapper/221:50:062
1132899140,14cyclictest0-21swapper/221:28:532
1132899140,14cyclictest0-21swapper/221:20:062
1132899140,14cyclictest0-21swapper/220:50:292
1132899140,14cyclictest0-21swapper/220:43:162
1132899140,14cyclictest0-21swapper/220:00:182
1132899140,14cyclictest0-21swapper/219:15:152
1132899140,14cyclictest0-21swapper/219:12:072
1132899140,14cyclictest0-21swapper/200:16:442
1132899140,0cyclictest0-21swapper/220:25:352
1132899140,0cyclictest0-21swapper/219:36:372
11327991414,0cyclictest0-21swapper/123:00:111
11327991414,0cyclictest0-21swapper/119:20:221
11327991414,0cyclictest0-21swapper/100:05:321
1132799140,14cyclictest0-21swapper/123:15:381
1132799140,14cyclictest0-21swapper/122:25:391
1132799140,14cyclictest0-21swapper/122:05:411
1132799140,14cyclictest0-21swapper/121:51:231
1132799140,14cyclictest0-21swapper/121:25:101
1132799140,14cyclictest0-21swapper/120:50:231
1132799140,14cyclictest0-21swapper/120:45:171
1132799140,14cyclictest0-21swapper/120:40:591
1132799140,14cyclictest0-21swapper/120:25:131
1132799140,14cyclictest0-21swapper/120:02:541
1132799140,14cyclictest0-21swapper/119:50:141
1132799140,14cyclictest0-21swapper/119:11:381
1132799140,14cyclictest0-21swapper/100:15:421
1132799140,0cyclictest31710-21apt-get22:10:121
1132799140,0cyclictest0-21swapper/123:40:081
1132799140,0cyclictest0-21swapper/123:20:311
1132799140,0cyclictest0-21swapper/122:57:261
1132799140,0cyclictest0-21swapper/122:20:081
1132799140,0cyclictest0-21swapper/121:15:531
1132799140,0cyclictest0-21swapper/121:05:091
1132799140,0cyclictest0-21swapper/121:00:351
1132799140,0cyclictest0-21swapper/119:35:501
11323991414,0cyclictest0-21swapper/022:21:010
11323991414,0cyclictest0-21swapper/022:00:130
11323991414,0cyclictest0-21swapper/020:00:160
11323991414,0cyclictest0-21swapper/019:31:260
11323991414,0cyclictest0-21swapper/000:35:130
1132399140,14cyclictest0-21swapper/023:55:310
1132399140,14cyclictest0-21swapper/023:05:490
1132399140,14cyclictest0-21swapper/022:15:300
1132399140,14cyclictest0-21swapper/022:06:010
1132399140,14cyclictest0-21swapper/019:21:260
1132399140,14cyclictest0-21swapper/019:16:190
1132399140,14cyclictest0-21swapper/000:25:510
1132399140,0cyclictest0-21swapper/023:46:250
1132399140,0cyclictest0-21swapper/023:25:290
1132399140,0cyclictest0-21swapper/023:12:290
1132399140,0cyclictest0-21swapper/022:25:080
1132399140,0cyclictest0-21swapper/021:16:470
1132399140,0cyclictest0-21swapper/020:26:170
1132399140,0cyclictest0-21swapper/019:35:130
1132399140,0cyclictest0-21swapper/000:15:060
11329991313,0cyclictest0-21swapper/300:36:213
1132899130,0cyclictest0-21swapper/223:30:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional