You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 18:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Sun Nov 23, 2025 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2328699340,2cyclictest5209-21cron09:55:010
2328699310,0cyclictest0-21swapper/010:05:120
2328799300,29cyclictest15980-21sh09:10:011
23286993028,2cyclictest0-21swapper/012:35:130
23286993027,2cyclictest23332-21cron09:25:000
23286993024,5cyclictest13325-21sh12:30:010
23293992927,1cyclictest13943-21apt-get09:05:123
2329399290,28cyclictest26868-21munin-run08:25:013
2329399290,28cyclictest0-21swapper/310:55:143
2329399290,28cyclictest0-21swapper/308:10:013
2328799290,28cyclictest8121-21apt-get07:45:131
23286992927,2cyclictest30807-21apt-get07:25:110
2328699290,28cyclictest4629-21apt-get08:45:130
2328699290,28cyclictest25679-21perf09:30:000
23293992828,0cyclictest0-21swapper/307:30:123
2329399280,27cyclictest0-21swapper/308:50:113
23288992828,0cyclictest13620-21apt-get12:30:152
23288992826,1cyclictest7523-21cron10:00:002
23288992826,1cyclictest303-21systemd-journal09:10:012
23288992826,1cyclictest21909-21http10:30:012
2328899280,27cyclictest0-21swapper/212:15:012
2328899280,27cyclictest0-21swapper/210:50:132
2328899280,27cyclictest0-21swapper/210:10:142
2328899280,0cyclictest0-21swapper/210:35:132
23287992827,0cyclictest0-21swapper/109:00:121
23287992826,1cyclictest609-21dbus-daemon10:50:001
23287992826,1cyclictest22733-21apt-get11:40:131
2328799280,28cyclictest28485-21apt-get07:20:111
2328799280,27cyclictest0-21swapper/108:25:121
2328799280,0cyclictest0-21swapper/110:15:151
23286992828,0cyclictest0-21swapper/012:10:140
23286992827,1cyclictest15683-21apt-get11:25:110
2328699280,28cyclictest0-21swapper/011:55:110
23293992727,0cyclictest0-21swapper/308:30:123
23293992727,0cyclictest0-21swapper/307:45:133
23293992726,1cyclictest32372-21apt-get08:35:113
23293992726,0cyclictest30934-21apt-get09:40:123
2329399270,27cyclictest0-21swapper/311:25:113
2329399270,27cyclictest0-21swapper/309:15:113
2329399270,0cyclictest8419-21perf11:10:013
23288992727,0cyclictest15111-21apt-get10:15:152
23288992727,0cyclictest0-21swapper/207:55:022
23288992726,1cyclictest17743-21apt-get08:05:122
2328899270,27cyclictest0-21swapper/210:50:002
2328899270,0cyclictest0-21swapper/207:40:142
23287992727,0cyclictest0-21swapper/110:40:121
23287992726,1cyclictest29752-21apt-get08:30:121
2328799270,0cyclictest0-21swapper/110:30:011
2328799270,0cyclictest0-21swapper/108:05:121
23286992727,0cyclictest0-21swapper/011:50:130
23286992727,0cyclictest0-21swapper/009:40:120
23286992727,0cyclictest0-21swapper/007:10:130
23286992726,1cyclictest17489-21munin-run08:05:010
23286992726,1cyclictest0-21swapper/011:05:120
23293992626,0cyclictest0-21swapper/310:20:143
23293992626,0cyclictest0-21swapper/309:55:123
23293992626,0cyclictest0-21swapper/307:55:153
23288992626,0cyclictest0-21swapper/208:35:012
23288992626,0cyclictest0-21swapper/208:25:122
23288992626,0cyclictest0-21swapper/207:45:132
23288992626,0cyclictest0-21swapper/207:20:112
23287992626,0cyclictest27392-21apt-get11:50:131
23287992626,0cyclictest0-21swapper/110:30:121
23287992626,0cyclictest0-21swapper/110:20:131
23286992626,0cyclictest0-21swapper/007:55:150
23293992525,0cyclictest0-21swapper/312:30:143
23293992525,0cyclictest0-21swapper/310:10:143
23293992525,0cyclictest0-21swapper/307:30:013
23288992525,0cyclictest0-21swapper/209:00:112
23288992525,0cyclictest0-21swapper/208:10:132
23287992525,0cyclictest0-21swapper/112:25:111
23287992525,0cyclictest0-21swapper/110:35:131
23287992525,0cyclictest0-21swapper/107:15:131
23287992523,1cyclictest303-21systemd-journal07:35:011
23286992525,0cyclictest0-21swapper/009:05:120
23286992523,1cyclictest19522-21munin-run10:25:010
23293992424,0cyclictest24797-21apt-get10:35:133
23293992424,0cyclictest0-21swapper/308:45:123
23293992424,0cyclictest0-21swapper/308:00:123
23293992424,0cyclictest0-21swapper/307:15:013
23293992422,1cyclictest30524-21cron07:25:013
23288992424,0cyclictest0-21swapper/210:40:122
23288992424,0cyclictest0-21swapper/208:30:012
23287992422,1cyclictest0-21swapper/109:00:001
23286992424,0cyclictest0-21swapper/009:00:110
23288992323,0cyclictest0-21swapper/211:50:132
23288992323,0cyclictest0-21swapper/211:40:132
23288992323,0cyclictest0-21swapper/210:30:122
23288992323,0cyclictest0-21swapper/210:20:132
23288992322,0cyclictest26135-21apt-get07:15:132
23287992323,0cyclictest0-21swapper/112:35:011
23287992323,0cyclictest0-21swapper/109:25:001
23287992323,0cyclictest0-21swapper/107:35:121
2328799232,16cyclictest607-21irqbalance08:36:061
23287992321,1cyclictest4368-21munin-run08:45:001
23286992323,0cyclictest0-21swapper/010:10:140
23288992222,0cyclictest0-21swapper/212:25:112
23288992220,1cyclictest2758-21cron07:35:012
23288992220,1cyclictest23366-21perf09:25:002
23286992222,0cyclictest0-21swapper/012:20:130
23286992222,0cyclictest0-21swapper/012:05:130
23293992121,0cyclictest0-21swapper/312:20:133
23293992121,0cyclictest0-21swapper/310:05:113
23288992120,0cyclictest3040-21apt-get07:35:122
23286992121,0cyclictest0-21swapper/009:55:120
23288992018,1cyclictest11305-21cron09:00:002
23287992020,0cyclictest25957-21apt-get09:30:121
23287992020,0cyclictest0-21swapper/111:20:121
23287992018,1cyclictest17723-21cron11:30:011
23286992020,0cyclictest0-21swapper/009:15:110
23286992020,0cyclictest0-21swapper/007:30:120
23286992019,1cyclictest834-21apt-get09:45:130
23288991919,0cyclictest0-21swapper/212:35:022
23287991917,1cyclictest1680-21awk12:05:011
23287991916,2cyclictest6070-21cron11:05:011
23286991919,0cyclictest31792-21apt-get10:50:130
23286991919,0cyclictest0-21swapper/010:35:130
2329399184,14cyclictest0-21swapper/312:12:053
23293991818,0cyclictest0-21swapper/309:10:113
23293991817,1cyclictest2303-21apt-get08:40:113
23293991815,2cyclictest28196-21turbostat.cron07:20:013
23288991818,0cyclictest0-21swapper/208:45:002
23287991817,1cyclictest5492-21apt-get09:55:121
23286991818,0cyclictest15111-21apt-get10:15:140
23286991818,0cyclictest0-21swapper/008:40:120
23286991818,0cyclictest0-21swapper/007:50:120
23293991717,0cyclictest29715-21apt-get11:55:123
23293991717,0cyclictest27143-21apt-get10:40:133
23293991717,0cyclictest0-21swapper/310:50:133
23293991716,0cyclictest20390-21apt-get11:35:143
23288991717,0cyclictest0-21swapper/211:20:122
23288991717,0cyclictest0-21swapper/209:30:122
23288991714,2cyclictest17730-21cron11:30:012
23287991717,0cyclictest0-21swapper/111:35:141
23287991717,0cyclictest0-21swapper/108:20:141
23293991616,0cyclictest0-21swapper/312:10:013
23293991614,1cyclictest609-21dbus-daemon08:20:013
2329399160,15cyclictest1359-21perl09:45:153
2328899160,15cyclictest2618-21which12:05:152
23287991616,0cyclictest12789-21apt-get10:10:141
23287991614,1cyclictest31784-21perf12:00:011
23287991614,1cyclictest0-21swapper/112:21:231
23286991616,0cyclictest27125-21apt-get08:25:120
23286991615,1cyclictest5223-21munin-run07:40:000
23286991614,1cyclictest11351-21perf09:00:000
23286991614,1cyclictest0-21swapper/011:20:140
2328699160,16cyclictest0-21swapper/011:37:510
23293991515,0cyclictest0-21swapper/307:50:133
23293991513,1cyclictest0-21swapper/308:25:213
2329399151,14cyclictest20161-21snmpd12:02:343
2329399150,4cyclictest0-21swapper/311:30:133
2329399150,1cyclictest0-21swapper/310:35:013
2329399150,1cyclictest0-21swapper/309:29:383
2329399150,14cyclictest24388-21users11:40:223
2329399150,14cyclictest16769-21perl12:35:153
2329399150,14cyclictest0-21swapper/311:10:133
23288991514,1cyclictest609-21dbus-daemon12:05:012
23288991513,2cyclictest19395-21threads11:30:202
23288991513,1cyclictest303-21systemd-journal11:05:012
23288991513,1cyclictest11508-21ntp_states10:05:172
2328899150,1cyclictest0-21swapper/207:13:252
23287991514,1cyclictest15755-21kworker/1:008:17:001
23287991514,0cyclictest0-21swapper/110:00:111
23287991513,1cyclictest15649-21cron12:35:011
23287991513,1cyclictest0-21swapper/108:00:171
2328799150,14cyclictest0-21swapper/109:46:081
23286991514,1cyclictest19863-21perf08:10:010
23286991514,1cyclictest0-21swapper/010:04:560
23286991513,2cyclictest0-21swapper/008:30:010
23286991510,1cyclictest28194-21ntp_states10:40:180
2328699150,15cyclictest0-21swapper/012:31:340
2328699150,15cyclictest0-21swapper/011:42:230
2328699150,15cyclictest0-21swapper/009:39:210
23293991414,0cyclictest0-21swapper/312:17:363
23293991413,0cyclictest5496-21apt-get07:40:143
2329399140,14cyclictest0-21swapper/312:25:453
2329399140,14cyclictest0-21swapper/311:50:063
2329399140,14cyclictest0-21swapper/311:46:333
2329399140,14cyclictest0-21swapper/311:22:113
2329399140,14cyclictest0-21swapper/311:16:263
2329399140,14cyclictest0-21swapper/311:02:173
2329399140,14cyclictest0-21swapper/310:46:063
2329399140,14cyclictest0-21swapper/310:27:373
2329399140,14cyclictest0-21swapper/310:17:113
2329399140,14cyclictest0-21swapper/310:00:033
2329399140,14cyclictest0-21swapper/309:35:553
2329399140,14cyclictest0-21swapper/309:30:593
2329399140,14cyclictest0-21swapper/309:20:353
2329399140,14cyclictest0-21swapper/309:01:073
2329399140,14cyclictest0-21swapper/308:55:443
2329399140,0cyclictest0-21swapper/309:52:103
2329399140,0cyclictest0-21swapper/308:11:073
2329399140,0cyclictest0-21swapper/307:37:003
23288991414,0cyclictest0-21swapper/211:47:052
23288991414,0cyclictest0-21swapper/211:35:142
23288991414,0cyclictest0-21swapper/208:20:142
23288991413,1cyclictest0-21swapper/211:06:442
2328899140,14cyclictest0-21swapper/212:15:302
2328899140,14cyclictest0-21swapper/211:56:412
2328899140,14cyclictest0-21swapper/211:17:432
2328899140,14cyclictest0-21swapper/211:11:142
2328899140,14cyclictest0-21swapper/210:55:082
2328899140,14cyclictest0-21swapper/210:00:262
2328899140,14cyclictest0-21swapper/209:50:122
2328899140,14cyclictest0-21swapper/209:40:432
2328899140,14cyclictest0-21swapper/209:36:222
2328899140,14cyclictest0-21swapper/209:16:382
2328899140,14cyclictest0-21swapper/208:45:342
2328899140,14cyclictest0-21swapper/207:27:182
2328899140,0cyclictest0-21swapper/212:20:162
2328899140,0cyclictest0-21swapper/209:45:422
2328899140,0cyclictest0-21swapper/209:10:462
2328899140,0cyclictest0-21swapper/208:54:222
2328899140,0cyclictest0-21swapper/208:00:082
2328899140,0cyclictest0-21swapper/207:51:162
23287991414,0cyclictest0-21swapper/109:25:071
23287991414,0cyclictest0-21swapper/107:40:141
23287991414,0cyclictest0-21swapper/107:25:131
2328799140,14cyclictest0-21swapper/112:15:041
2328799140,14cyclictest0-21swapper/111:06:301
2328799140,14cyclictest0-21swapper/109:41:191
2328799140,14cyclictest0-21swapper/109:36:091
2328799140,14cyclictest0-21swapper/108:45:071
2328799140,14cyclictest0-21swapper/107:55:151
2328799140,14cyclictest0-21swapper/107:52:491
2328799140,0cyclictest0-21swapper/112:10:331
2328799140,0cyclictest0-21swapper/112:06:261
2328799140,0cyclictest0-21swapper/111:47:251
2328799140,0cyclictest0-21swapper/111:30:231
2328799140,0cyclictest0-21swapper/111:15:131
2328799140,0cyclictest0-21swapper/111:11:001
2328799140,0cyclictest0-21swapper/110:55:031
2328799140,0cyclictest0-21swapper/110:50:171
2328799140,0cyclictest0-21swapper/110:05:031
2328799140,0cyclictest0-21swapper/109:50:201
2328799140,0cyclictest0-21swapper/109:16:181
2328799140,0cyclictest0-21swapper/109:10:521
2328799140,0cyclictest0-21swapper/108:50:171
2328799140,0cyclictest0-21swapper/108:10:321
2328799140,0cyclictest0-21swapper/107:13:251
23286991412,2cyclictest0-21swapper/011:30:230
2328699140,14cyclictest0-21swapper/012:15:150
2328699140,14cyclictest0-21swapper/012:00:020
2328699140,14cyclictest0-21swapper/011:46:370
2328699140,14cyclictest0-21swapper/011:15:360
2328699140,14cyclictest0-21swapper/010:55:070
2328699140,14cyclictest0-21swapper/010:45:380
2328699140,14cyclictest0-21swapper/010:25:470
2328699140,14cyclictest0-21swapper/009:10:060
2328699140,14cyclictest0-21swapper/008:51:010
2328699140,14cyclictest0-21swapper/008:36:060
2328699140,14cyclictest0-21swapper/008:10:100
2328699140,14cyclictest0-21swapper/007:40:090
2328699140,14cyclictest0-21swapper/007:21:430
2328699140,14cyclictest0-21swapper/007:15:080
2328699140,0cyclictest0-21swapper/011:13:530
2328699140,0cyclictest0-21swapper/011:00:030
2328699140,0cyclictest0-21swapper/010:30:410
2328699140,0cyclictest0-21swapper/009:30:410
2328699140,0cyclictest0-21swapper/008:21:180
2328699140,0cyclictest0-21swapper/008:16:330
2328699140,0cyclictest0-21swapper/007:45:090
2328899130,0cyclictest0-21swapper/209:25:422
2328899130,0cyclictest0-21swapper/208:15:282
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional