You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 09:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8.osadl.org (updated Sat Nov 29, 2025 00:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
260514699231,15cyclictest2807059-21taskset21:40:013
2605146992118,1cyclictest0-21swapper/323:30:013
2605146992118,1cyclictest0-21swapper/322:05:003
260514699211,15cyclictest3009986-21taskset23:45:123
2605146992017,1cyclictest0-21swapper/321:05:153
2605146992014,3cyclictest2782631-21turbostat21:25:003
260514699201,13cyclictest2968889-21taskset23:19:563
2605146991916,1cyclictest0-21swapper/321:15:003
260514699191,13cyclictest3017878-21chrt23:50:023
260514699191,13cyclictest2904221-21taskset22:40:003
260514699182,6cyclictest2823205-21turbostat21:50:003
2605146991816,1cyclictest0-21swapper/322:10:193
2605146991815,1cyclictest0-21swapper/323:00:243
2605146991815,1cyclictest0-21swapper/321:15:213
2605146991815,1cyclictest0-21swapper/320:45:173
2605146991815,1cyclictest0-21swapper/319:50:003
260514699181,13cyclictest3066053-21turbostat00:20:003
260514699181,13cyclictest2953157-21taskset23:10:133
260514699181,12cyclictest3042063-21taskset00:05:003
260514699178,6cyclictest29520352sleep323:08:513
2605146991714,1cyclictest0-21swapper/322:35:003
2605146991714,1cyclictest0-21swapper/319:55:013
2605146991714,1cyclictest0-21swapper/319:15:013
2605146991714,1cyclictest0-21swapper/300:30:003
260514699171,13cyclictest2888107-21turbostat22:30:003
260514699171,12cyclictest3082731-21taskset00:30:123
260514699171,12cyclictest3072026-21taskset00:20:233
260514699171,12cyclictest2708277-21taskset20:29:563
260514699171,12cyclictest2682925-21turbostat20:10:003
260514699171,12cyclictest2626666-21taskset19:25:113
260514699170,15cyclictest2695511-21turbostat20:24:543
260514699170,13cyclictest2936387-21taskset22:59:563
307432921612,2sleep23074382-21systemd-run00:24:592
26200292161,2sleep00-21swapper/019:20:010
2605146991613,1cyclictest0-21swapper/322:15:153
2605146991613,1cyclictest0-21swapper/320:02:003
260514699161,12cyclictest3056136-21taskset00:10:503
260514699161,12cyclictest3032113-21taskset23:56:183
260514699161,12cyclictest2999637-21taskset23:35:313
260514699161,12cyclictest2928400-21turbostat22:54:593
260514699161,12cyclictest2880083-21sleep22:25:003
260514699161,12cyclictest2834471-21taskset21:55:163
260514699161,12cyclictest2783349-21taskset21:25:143
260514699161,12cyclictest2739464-21taskset20:52:243
260514699161,12cyclictest2726894-21taskset20:42:263
260514699161,12cyclictest2695420-21taskset20:19:143
260514699161,12cyclictest2644775-21taskset19:36:453
260514699161,11cyclictest2651214-21chrt19:40:233
260514699160,13cyclictest3009588-21taskset23:44:573
260514699160,11cyclictest2605285-21taskset19:10:013
2605146991512,1cyclictest0-21swapper/321:30:473
260514699151,12cyclictest2993383-21taskset23:34:473
260514699151,12cyclictest2714407-21chrt20:33:323
260514699151,12cyclictest2670183-21taskset19:57:463
260514699151,11cyclictest3040270-21taskset00:01:203
260514699151,11cyclictest2974769-21taskset23:20:243
260514699151,11cyclictest2904450-21taskset22:40:043
260514699151,11cyclictest2904450-21taskset22:40:043
260514699151,11cyclictest2847898-21taskset22:05:053
260514699151,11cyclictest2829828-21taskset21:51:433
260514699151,11cyclictest2812633-21taskset21:40:213
260514699151,11cyclictest2637935-21taskset19:30:213
260514699151,11cyclictest2626186-21taskset19:23:483
260514699150,12cyclictest3090816-21taskset00:35:103
260514699150,12cyclictest2720536-21chrt20:36:493
260514699150,12cyclictest2720536-21chrt20:36:493
260514699150,12cyclictest2683192-21chrt20:10:123
260514699150,11cyclictest2916609-21taskset22:45:173
260514699150,11cyclictest2916609-21taskset22:45:173
147598150,5rtkit-daemon2869474-21ntp_states22:15:210
147598150,10rtkit-daemon2626743-21fschecks_count19:25:131
2605146991411,1cyclictest0-21swapper/320:55:053
260514699141,10cyclictest2746203-21taskset21:00:063
147598140,10rtkit-daemon2828549-21ssh21:50:200
26392142131,9sleep22639020-21/usr/sbin/munin19:35:142
147598130,9rtkit-daemon2887379-21ssh22:28:141
30826932122,6sleep23082728-21apt-get00:30:122
29439392120,9sleep22943947-21ssh23:03:362
28080002121,7sleep22808803-21kthreadcore21:40:172
27829662122,5sleep02782969-21apt-get21:25:110
26265722121,8sleep22626662-21grep19:25:112
147598120,3rtkit-daemon2994189-21tail23:35:152
30160752111,7sleep23016082-21sh23:46:242
29287082110,8sleep02928712-21acpi22:55:130
28549702110,8sleep02854978-21ssh22:08:120
28019342110,7sleep22803967-21kthreadcore21:35:202
26116902111,3sleep22611363-21apt-get19:15:012
260514699118,1cyclictest0-21swapper/319:10:013
147598110,7rtkit-daemon2710009-21cat20:30:192
147598110,7rtkit-daemon22110-21packagekitd21:10:331
147598110,6rtkit-daemon1540-21sendmail-mta23:26:132
147598110,4rtkit-daemon22110-21packagekitd20:19:432
147598110,2rtkit-daemon214-21plymouthd23:03:360
147598110,2rtkit-daemon214-21plymouthd21:30:270
30816902100,1sleep00-21swapper/000:28:190
30670882107,1sleep00-21swapper/000:20:170
30425712105,2sleep13043064-21irqcore00:05:151
30094152106,2sleep13009421-21ssh23:44:361
28949632100,7sleep02894971-21ssh22:32:200
28745002100,7sleep02876493-21cut22:20:180
28332352100,7sleep22834470-21grep21:55:152
27350352101,2sleep00-21swapper/020:50:180
27277952100,7sleep12728586-21cut20:45:181
26791642102,5sleep02681208-21grep20:05:180
26606672100,7sleep12662757-21tr19:50:191
26327772100,7sleep12632810-21apt-get19:30:121
26113362101,5sleep12611689-21cut19:15:011
147598100,6rtkit-daemon2881601-21cut22:25:152
147598100,6rtkit-daemon2839612-21latency_hist22:00:000
147598100,3rtkit-daemon720-21snmpd21:39:330
147598100,3rtkit-daemon515-21gmain23:08:280
147598100,2rtkit-daemon2896409-21sh22:35:102
147598100,2rtkit-daemon214-21plymouthd23:20:230
147598100,2rtkit-daemon214-21plymouthd00:03:391
3018431290,6sleep13019364-21irqrtprio23:50:171
3012752290,6sleep03014809-21tr23:45:190
2959024290,6sleep12959032-21ssh23:10:451
2953115292,3sleep22953152-21apt-get23:10:142
2943585290,3sleep10-21swapper/123:02:521
2930157292,5sleep22927648-21kworker/u16:2+nfsiod22:55:192
2896465290,6sleep02896478-21cpu22:35:140
2847979290,6sleep12848136-21df22:05:131
2815431290,2sleep22815439-21ssh21:45:102
2775224290,7sleep02775360-21ps21:20:150
2766068291,2sleep0214-21plymouthd21:14:060
2684795290,6sleep02686778-21tr20:10:190
2638063290,7sleep02638205-21cat19:30:230
2604176291,4sleep12604301-21python319:05:231
14759890,6rtkit-daemon0-21swapper/223:15:172
14759890,5rtkit-daemon476-21wpa_supplicant23:56:382
14759890,5rtkit-daemon476-21wpa_supplicant19:17:551
14759890,5rtkit-daemon313-21systemd-udevd00:39:420
14759890,5rtkit-daemon1540-21sendmail-mta23:10:280
14759890,3rtkit-daemon1-21systemd23:31:302
3090486281,4sleep03090518-21munin-run00:35:000
3089376281,4sleep13082607-21kworker/u16:1+rpciod00:32:251
3080826282,4sleep12998813-21kworker/u16:2+xprtiod00:26:231
3058474281,4sleep23058527-21cut00:15:142
3049666280,6sleep23049671-21sh00:09:332
3035443280,2sleep00-21swapper/000:00:170
2985689281,3sleep02985728-21apt-get23:30:120
2984330280,4sleep12984338-21ssh23:28:031
2845820280,6sleep22845822-21ssh22:00:492
2807751280,6sleep12807999-21sed21:40:161
2805981280,5sleep12805985-21ssh21:37:391
2774864281,4sleep12774896-21apt-get21:20:121
2774387281,4sleep22774395-21ssh21:19:372
2727095280,5sleep02727277-21latency_hist20:45:000
2721248281,4sleep22721316-21/usr/sbin/munin20:40:142
2669830280,6sleep02669994-21/usr/sbin/munin19:55:240
2620307280,4sleep02620340-21apt-get19:20:130
14759880,4rtkit-daemon720-21snmpd22:30:161
14759880,4rtkit-daemon425-21rpcbind21:18:280
14759880,4rtkit-daemon2977769-21fw_packets23:25:140
14759880,4rtkit-daemon2920575-21cat22:50:112
14759880,4rtkit-daemon2873346-21sed22:20:171
14759880,4rtkit-daemon2701781-21cron20:24:592
14759880,4rtkit-daemon22110-21packagekitd19:20:331
14759880,4rtkit-daemon214-21plymouthd22:45:152
14759880,4rtkit-daemon214-21plymouthd22:45:142
14759880,4rtkit-daemon214-21plymouthd22:04:290
14759880,4rtkit-daemon1-21systemd22:41:362
14759880,4rtkit-daemon1-21systemd22:41:362
14759880,3rtkit-daemon2657866-21sh19:50:002
14759880,3rtkit-daemon214-21plymouthd21:42:300
3093099271,3sleep23095073-21sh00:35:182
3081921271,4sleep20-21swapper/200:28:572
3058281271,3sleep03058318-21apt-get00:15:120
3055688270,4sleep1214-21plymouthd00:10:231
2967550270,4sleep1295-21systemd-journal23:16:451
2952530271,3sleep10-21swapper/123:10:011
2933920273,2sleep12934000-21ntpq22:55:221
2927246270,2sleep00-21swapper/022:52:250
2912917271,3sleep02913595-21cut22:45:150
2912917271,3sleep02913595-21cut22:45:150
2910263270,5sleep00-21swapper/022:40:350
2910263270,5sleep00-21swapper/022:40:340
2902187270,4sleep12902191-21ssh22:35:271
2895514271,4sleep22895522-21ssh22:33:392
2888081271,3sleep00-21swapper/022:30:010
2853258271,4sleep22853389-21python322:05:212
2837753270,1sleep10-21swapper/121:55:421
2831240270,4sleep22831267-21awk21:55:002
2815382270,1sleep00-21swapper/021:45:030
2795912270,4sleep22796096-21cut21:30:192
2790607270,1sleep10-21swapper/121:29:581
2781608270,5sleep22781616-21ssh21:22:382
2753876271,3sleep12755328-21grep21:05:181
2741508270,4sleep02743465-21cut20:55:190
2714234270,1sleep00-21swapper/020:31:220
2701767270,4sleep02701789-21apt-get20:25:010
2640725271,3sleep1214-21plymouthd19:35:171
2604671270,1sleep00-21swapper/019:05:540
14759870,4rtkit-daemon730-21ntpd20:11:482
14759870,4rtkit-daemon2611631-21munin-node23:59:021
14759870,4rtkit-daemon2611631-21munin-node19:51:172
14759870,4rtkit-daemon1-21systemd20:07:262
14759870,4rtkit-daemon1-21systemd20:01:082
14759870,4rtkit-daemon0-21swapper/220:36:232
14759870,4rtkit-daemon0-21swapper/220:36:232
14759870,3rtkit-daemon730-21ntpd19:55:332
14759870,3rtkit-daemon730-21ntpd00:35:151
14759870,3rtkit-daemon730-21ntpd00:22:421
14759870,3rtkit-daemon515-21gmain00:15:131
14759870,3rtkit-daemon2753606-21sed21:05:162
14759870,3rtkit-daemon2744040-21grep20:55:192
14759870,3rtkit-daemon2738827-21ntp_states20:50:202
14759870,3rtkit-daemon2611631-21munin-node23:51:142
14759870,3rtkit-daemon214-21plymouthd23:40:132
14759870,3rtkit-daemon214-21plymouthd22:19:571
14759870,3rtkit-daemon214-21plymouthd21:11:522
14759870,3rtkit-daemon1-21systemd20:45:142
14759870,3rtkit-daemon1-21systemd19:31:252
14759870,2rtkit-daemon214-21plymouthd22:10:020
3056042260,3sleep23056050-21ssh00:10:372
3048458260,4sleep00-21swapper/000:06:430
3041419260,1sleep20-21swapper/200:04:002
3033360261,3sleep03033367-21sh23:59:170
3002844260,3sleep03003962-21cut23:40:180
2992994261,3sleep12993000-21ssh23:33:501
2970898260,3sleep12972819-21kthreadcore23:20:191
2961187260,3sleep02830567-21kworker/0:0+kacpid23:15:080
2952212260,4sleep2214-21plymouthd23:09:142
2920594260,3sleep12920742-21expr22:50:131
2918434260,1sleep10-21swapper/122:45:451
2918434260,1sleep10-21swapper/122:45:441
2910972260,4sleep12910980-21ssh22:42:121
2910972260,4sleep12910980-21ssh22:42:111
2879155260,1sleep20-21swapper/222:23:012
2862495260,1sleep20-21swapper/222:11:552
2856113261,2sleep10-21swapper/122:10:141
2839941260,3sleep12839979-21apt22:00:121
2821736260,1sleep10-21swapper/121:46:321
2789103260,1sleep20-21swapper/221:26:272
2751389261,2sleep20-21swapper/221:00:212
2745607263,1sleep1331ktimers/120:55:521
2727583261,2sleep00-21swapper/020:45:170
2726740260,1sleep10-21swapper/120:40:281
2719962261,2sleep10-21swapper/120:35:241
2719962261,2sleep10-21swapper/120:35:241
2709203261,2sleep12710168-21kthreadcore20:30:191
2701709260,1sleep00-21swapper/020:24:170
2695205260,1sleep00-21swapper/020:16:320
2683356260,3sleep12683556-21hddtemp_smartct20:10:151
2651832260,3sleep02611579-21kworker/0:3+kacpid19:45:100
2626078260,1sleep20-21swapper/219:22:282
2611121260,1sleep00-21swapper/019:12:160
14759860,3rtkit-daemon2611631-21munin-node19:40:132
14759860,2rtkit-daemon214-21plymouthd23:49:341
14759860,2rtkit-daemon214-21plymouthd20:25:592
3056917250,3sleep00-21swapper/000:12:350
2999680250,3sleep00-21swapper/023:35:450
2994521250,2sleep10-21swapper/123:35:171
2975822252,2sleep22605141-21cyclictest23:22:042
2870278250,3sleep20-21swapper/222:16:122
2824604250,2sleep10-21swapper/121:50:181
2773728250,3sleep10-21swapper/121:18:041
2758359250,3sleep00-21swapper/021:08:450
2736175250,2sleep10-21swapper/120:50:181
2715736250,2sleep00-21swapper/020:35:190
2715736250,2sleep00-21swapper/020:35:180
2704237250,2sleep10-21swapper/120:25:181
2701611250,3sleep10-21swapper/120:23:021
2682870250,2sleep1214-21plymouthd20:09:351
2670670250,3sleep02670826-21diskstats20:00:120
2665512251,2sleep10-21swapper/119:55:171
2659506251,2sleep00-21swapper/019:50:180
2651341250,3sleep00-21swapper/019:42:000
2651289250,3sleep10-21swapper/119:41:221
2644787251,2sleep02611631-21munin-node19:36:560
2632364250,3sleep00-21swapper/019:27:590
2605604252,1sleep20-21swapper/219:10:172
2603308250,2sleep22603996-21missed_timers19:05:202
3024299240,2sleep0214-21plymouthd23:51:480
2790856240,2sleep1214-21plymouthd21:30:021
2747030240,2sleep10-21swapper/121:00:161
2746606240,2sleep00-21swapper/021:00:160
2654318240,2sleep10-21swapper/119:45:191
2689440230,1sleep10-21swapper/120:15:041
2670631230,1sleep10-21swapper/120:00:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional