You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 13:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Sat Dec 06, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2232799320,1cyclictest609-21dbus-daemon00:00:012
22327993127,3cyclictest0-21swapper/221:40:102
2232799300,29cyclictest303-21systemd-journal00:20:022
2231999300,29cyclictest28672-21sendmail-msp21:40:000
2232999290,1cyclictest5857-21cron22:00:023
2232799290,28cyclictest8496-21apt-get22:05:122
2232799290,1cyclictest0-21swapper/222:30:002
2232799290,1cyclictest0-21swapper/219:45:132
2232299290,29cyclictest13419-21apt-get23:25:151
2232299290,28cyclictest0-21swapper/122:00:011
2231999290,28cyclictest0-21swapper/023:30:120
2232999280,0cyclictest0-21swapper/322:00:123
2232799280,27cyclictest0-21swapper/223:15:142
2232799280,0cyclictest15549-21apt-get22:20:152
2232799280,0cyclictest0-21swapper/222:50:132
22322992828,0cyclictest0-21swapper/123:40:121
22322992828,0cyclictest0-21swapper/119:30:021
2232299280,28cyclictest15795-21apt-get23:30:121
2232299280,28cyclictest0-21swapper/121:45:021
22319992828,0cyclictest0-21swapper/023:10:120
22319992828,0cyclictest0-21swapper/020:50:130
22319992828,0cyclictest0-21swapper/019:55:130
2231999280,0cyclictest31913-21apt-get19:30:020
22329992727,0cyclictest0-21swapper/323:05:123
22329992727,0cyclictest0-21swapper/319:30:023
22329992725,1cyclictest3814-21sh23:05:003
22329992725,1cyclictest0-21swapper/323:25:013
2232999270,0cyclictest0-21swapper/320:10:163
22327992727,0cyclictest0-21swapper/223:20:162
22327992727,0cyclictest0-21swapper/200:25:152
22322992727,0cyclictest0-21swapper/122:00:121
22319992727,0cyclictest0-21swapper/023:50:120
22319992727,0cyclictest0-21swapper/021:10:120
22319992725,1cyclictest23142-21sh20:20:010
22329992626,0cyclictest385-21apt-get00:05:133
22329992626,0cyclictest0-21swapper/322:35:133
22329992626,0cyclictest0-21swapper/321:15:133
22329992626,0cyclictest0-21swapper/320:30:143
22327992626,0cyclictest0-21swapper/223:25:152
22327992626,0cyclictest0-21swapper/221:10:122
22327992626,0cyclictest0-21swapper/220:35:112
22327992625,1cyclictest2395-21apt-get19:35:122
22322992626,0cyclictest0-21swapper/122:40:151
22322992626,0cyclictest0-21swapper/120:10:161
22329992525,0cyclictest0-21swapper/321:50:123
22329992525,0cyclictest0-21swapper/320:35:113
22329992525,0cyclictest0-21swapper/320:20:133
22329992525,0cyclictest0-21swapper/319:35:133
22329992525,0cyclictest0-21swapper/300:30:143
22329992524,0cyclictest8488-21munin-run23:15:013
22329992523,1cyclictest4698-21idleruntime-cro20:50:003
22327992525,0cyclictest0-21swapper/200:00:142
22322992524,1cyclictest4097-21apt-get23:05:121
22322992523,1cyclictest303-21systemd-journal23:05:001
22322992520,2cyclictest22-21ksoftirqd/122:40:011
22319992525,0cyclictest0-21swapper/023:45:140
22319992525,0cyclictest0-21swapper/023:25:010
22319992525,0cyclictest0-21swapper/022:30:120
22319992525,0cyclictest0-21swapper/020:40:130
22329992424,0cyclictest0-21swapper/321:00:133
22329992424,0cyclictest0-21swapper/300:10:123
22327992424,0cyclictest0-21swapper/223:05:122
22327992422,1cyclictest4800-21awk00:15:012
22327992422,1cyclictest3540-21awk21:55:012
22322992424,0cyclictest0-21swapper/100:05:141
22322992422,1cyclictest13135-21cron23:25:011
22319992424,0cyclictest0-21swapper/020:30:140
22319992424,0cyclictest0-21swapper/019:35:120
22319992424,0cyclictest0-21swapper/000:05:130
22319992423,1cyclictest26944-21sh19:20:010
22319992422,1cyclictest14200-21munin-run00:35:010
22329992322,1cyclictest27797-21turbostat.cron20:30:003
22329992322,1cyclictest18475-21dump-pmu-power20:10:013
22329992321,1cyclictest13739-21cron20:00:013
22327992323,0cyclictest0-21swapper/223:00:122
22322992323,0cyclictest30409-21apt-get20:35:111
22322992323,0cyclictest28087-21apt-get20:30:141
22322992323,0cyclictest0-21swapper/121:50:121
22322992323,0cyclictest0-21swapper/121:15:131
22322992323,0cyclictest0-21swapper/120:20:131
22322992323,0cyclictest0-21swapper/119:35:121
22322992323,0cyclictest0-21swapper/100:30:141
22322992322,1cyclictest211rcuc/123:15:021
22319992323,0cyclictest0-21swapper/023:35:130
22319992323,0cyclictest0-21swapper/019:40:130
22329992222,0cyclictest0-21swapper/322:55:143
22329992222,0cyclictest0-21swapper/321:35:123
22329992222,0cyclictest0-21swapper/320:50:133
22329992222,0cyclictest0-21swapper/319:45:133
22327992222,0cyclictest0-21swapper/222:10:132
22327992222,0cyclictest0-21swapper/220:40:122
22322992222,0cyclictest0-21swapper/121:00:131
22322992220,2cyclictest4707-21idleruntime-cro20:50:011
22319992222,0cyclictest0-21swapper/023:45:000
22319992222,0cyclictest0-21swapper/020:10:160
22319992222,0cyclictest0-21swapper/019:25:110
22319992222,0cyclictest0-21swapper/019:25:110
22319992222,0cyclictest0-21swapper/000:15:130
22329992120,1cyclictest19916-21perf22:30:003
22329992120,1cyclictest12289-21apt-get21:05:133
22329992119,1cyclictest0-21swapper/321:20:123
22327992121,0cyclictest0-21swapper/223:40:122
22327992120,0cyclictest9965-21apt-get21:00:132
22327992119,1cyclictest24841-21cron23:50:002
22322992121,0cyclictest0-21swapper/100:10:121
22322992120,1cyclictest7062-21apt-get19:45:131
22322992119,1cyclictest27796-21cron20:30:001
22322992119,1cyclictest18476-21cron20:10:021
22322992119,1cyclictest13764-21sendmail-msp20:00:011
22329992020,0cyclictest0-21swapper/321:10:123
22329992020,0cyclictest0-21swapper/320:15:133
22327992020,0cyclictest0-21swapper/221:30:122
22327992020,0cyclictest0-21swapper/220:45:092
22327992020,0cyclictest0-21swapper/219:15:122
22327992018,1cyclictest8239-21perf22:05:012
22322992020,0cyclictest5294-21apt-get20:50:131
22322992020,0cyclictest0-21swapper/122:55:141
22322992020,0cyclictest0-21swapper/121:35:131
22319992020,0cyclictest0-21swapper/023:55:150
22327991919,0cyclictest26621-21apt-get21:35:122
22327991919,0cyclictest0-21swapper/220:00:132
22327991918,1cyclictest27195-21apt-get22:45:112
22327991918,1cyclictest23995-21cron21:30:002
22327991918,1cyclictest0-21swapper/222:45:012
22322991918,1cyclictest22-21ksoftirqd/123:20:011
22322991918,0cyclictest0-21swapper/122:30:001
22322991917,1cyclictest19341-21runrttasks21:20:121
22319991919,0cyclictest0-21swapper/021:20:000
22329991818,0cyclictest0-21swapper/300:20:113
22329991816,1cyclictest331rcuc/323:20:013
22322991818,0cyclictest0-21swapper/120:15:131
22319991818,0cyclictest0-21swapper/019:20:120
22319991817,1cyclictest0-21swapper/000:20:110
22329991717,0cyclictest0-21swapper/322:45:113
22327991717,0cyclictest4741-21apt-get19:40:122
22327991717,0cyclictest0-21swapper/221:45:132
22322991717,0cyclictest14667-21apt-get21:10:121
22322991717,0cyclictest0-21swapper/121:05:131
22319991717,0cyclictest0-21swapper/021:25:010
22319991715,1cyclictest6166-21munin-run23:10:000
22319991714,2cyclictest303-21systemd-journal21:35:000
2232799160,15cyclictest8957-21switchtime20:55:212
2232799160,15cyclictest25621-21tr23:50:122
22322991616,0cyclictest0-21swapper/100:20:111
2232299160,15cyclictest10431-21ntp_states19:50:181
22319991616,0cyclictest12023-21perf21:05:000
22319991616,0cyclictest0-21swapper/022:45:110
22319991616,0cyclictest0-21swapper/022:20:150
22319991616,0cyclictest0-21swapper/020:55:120
22319991616,0cyclictest0-21swapper/020:25:140
2232999150,1cyclictest0-21swapper/323:25:243
2232999150,1cyclictest0-21swapper/319:26:323
2232999150,1cyclictest0-21swapper/319:26:323
2232999150,14cyclictest0-21swapper/322:50:133
2232999150,14cyclictest0-21swapper/322:05:123
22327991515,0cyclictest0-21swapper/223:35:132
22327991515,0cyclictest0-21swapper/221:55:112
22327991513,1cyclictest26805-21ntp_states20:25:192
22327991513,1cyclictest1470-21ntp_states00:05:182
22327991513,1cyclictest0-21swapper/220:05:152
2232799150,1cyclictest23955-21fschecks_time20:20:152
2232799150,14cyclictest0-21swapper/220:10:212
22322991515,0cyclictest0-21swapper/122:45:111
2232299150,9cyclictest607-21irqbalance22:07:561
22319991515,0cyclictest0-21swapper/022:05:120
22319991514,1cyclictest4823-21perf00:15:010
22319991513,1cyclictest9168-21wc19:50:000
22319991513,1cyclictest4466-21hddtemp_smartct21:55:140
22319991513,1cyclictest13648-21expr23:25:160
2231999150,6cyclictest8370-21latency_hist22:05:010
2231999150,14cyclictest0-21swapper/022:35:150
2231999150,14cyclictest0-21swapper/020:45:130
22329991414,0cyclictest0-21swapper/319:42:583
2232999140,14cyclictest0-21swapper/323:51:003
2232999140,14cyclictest0-21swapper/323:45:103
2232999140,14cyclictest0-21swapper/323:40:503
2232999140,14cyclictest0-21swapper/323:30:453
2232999140,14cyclictest0-21swapper/322:40:493
2232999140,14cyclictest0-21swapper/322:30:483
2232999140,14cyclictest0-21swapper/322:20:133
2232999140,14cyclictest0-21swapper/322:15:033
2232999140,14cyclictest0-21swapper/321:45:223
2232999140,14cyclictest0-21swapper/321:32:283
2232999140,14cyclictest0-21swapper/321:26:143
2232999140,14cyclictest0-21swapper/320:55:033
2232999140,14cyclictest0-21swapper/320:40:483
2232999140,14cyclictest0-21swapper/320:01:243
2232999140,14cyclictest0-21swapper/319:51:073
2232999140,14cyclictest0-21swapper/319:17:303
2232999140,14cyclictest0-21swapper/319:13:393
2232999140,14cyclictest0-21swapper/300:25:443
2232999140,14cyclictest0-21swapper/300:18:393
2232999140,14cyclictest0-21swapper/300:00:113
2232999140,0cyclictest0-21swapper/323:55:303
2232999140,0cyclictest0-21swapper/323:36:163
2232999140,0cyclictest0-21swapper/322:11:413
2232999140,0cyclictest0-21swapper/321:40:403
2232999140,0cyclictest0-21swapper/319:20:053
2232999140,0cyclictest0-21swapper/300:35:053
22327991414,0cyclictest29297-21apt-get19:25:032
22327991414,0cyclictest29297-21apt-get19:25:022
22327991413,1cyclictest1485-21/usr/sbin/munin19:30:202
2232799140,14cyclictest0-21swapper/223:11:042
2232799140,14cyclictest0-21swapper/222:55:282
2232799140,14cyclictest0-21swapper/222:36:192
2232799140,14cyclictest0-21swapper/222:31:072
2232799140,14cyclictest0-21swapper/222:15:422
2232799140,14cyclictest0-21swapper/221:18:262
2232799140,14cyclictest0-21swapper/221:07:212
2232799140,14cyclictest0-21swapper/220:50:092
2232799140,14cyclictest0-21swapper/219:50:242
2232799140,14cyclictest0-21swapper/219:12:472
2232799140,14cyclictest0-21swapper/200:35:252
2232799140,14cyclictest0-21swapper/200:32:582
2232799140,14cyclictest0-21swapper/200:20:292
2232799140,0cyclictest0-21swapper/220:31:382
2232799140,0cyclictest0-21swapper/219:58:092
2232799140,0cyclictest0-21swapper/219:20:572
22322991414,0cyclictest0-21swapper/119:15:161
22322991414,0cyclictest0-21swapper/119:12:381
22322991414,0cyclictest0-21swapper/100:25:401
22322991413,1cyclictest882-21perl20:40:151
22322991413,1cyclictest30567-21ntp_states22:50:181
2232299140,14cyclictest0-21swapper/123:56:031
2232299140,14cyclictest0-21swapper/123:50:521
2232299140,14cyclictest0-21swapper/122:30:041
2232299140,14cyclictest0-21swapper/122:21:031
2232299140,14cyclictest0-21swapper/122:15:121
2232299140,14cyclictest0-21swapper/122:10:081
2232299140,14cyclictest0-21swapper/121:40:021
2232299140,14cyclictest0-21swapper/120:55:581
2232299140,14cyclictest0-21swapper/119:41:021
2232299140,14cyclictest0-21swapper/119:20:421
2232299140,14cyclictest0-21swapper/100:15:261
2232299140,0cyclictest0-21swapper/123:45:241
2232299140,0cyclictest0-21swapper/123:36:201
2232299140,0cyclictest0-21swapper/121:30:251
2232299140,0cyclictest0-21swapper/121:26:141
2232299140,0cyclictest0-21swapper/120:00:351
2232299140,0cyclictest0-21swapper/119:25:041
2232299140,0cyclictest0-21swapper/119:25:041
2232299140,0cyclictest0-21swapper/100:35:521
2232299140,0cyclictest0-21swapper/100:00:011
22319991414,0cyclictest0-21swapper/022:44:170
22319991414,0cyclictest0-21swapper/019:51:400
22319991414,0cyclictest0-21swapper/019:13:240
22319991414,0cyclictest0-21swapper/000:00:390
2231999140,14cyclictest0-21swapper/023:00:090
2231999140,14cyclictest0-21swapper/022:25:210
2231999140,14cyclictest0-21swapper/022:10:070
2231999140,14cyclictest0-21swapper/021:41:390
2231999140,14cyclictest0-21swapper/021:20:590
2231999140,14cyclictest0-21swapper/020:35:060
2231999140,14cyclictest0-21swapper/020:21:020
2231999140,14cyclictest0-21swapper/000:25:470
2231999140,0cyclictest0-21swapper/023:15:150
2231999140,0cyclictest0-21swapper/022:55:010
2231999140,0cyclictest0-21swapper/022:16:080
2231999140,0cyclictest0-21swapper/021:51:090
2231999140,0cyclictest0-21swapper/021:45:160
2231999140,0cyclictest0-21swapper/021:05:110
2231999140,0cyclictest0-21swapper/020:06:220
2231999140,0cyclictest0-21swapper/020:00:390
2231999140,0cyclictest0-21swapper/000:35:290
22327991313,0cyclictest0-21swapper/221:20:022
22327991313,0cyclictest0-21swapper/220:15:052
2232799130,0cyclictest0-21swapper/223:30:312
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional