You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-14 - 03:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Fri Aug 14, 2026 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
160852216202,10sleep10-21swapper/119:05:381
163192195179,11sleep00-21swapper/019:08:380
162652190156,12sleep30-21swapper/319:07:573
161972176159,13sleep20-21swapper/219:07:042
138832760,0sleep30-21swapper/323:36:563
138832760,0sleep30-21swapper/323:36:563
74832460,0sleep10-21swapper/123:00:431
311802120,0sleep00-21swapper/022:40:160
101282120,1sleep20-21swapper/222:30:042
201612110,0sleep30-21swapper/321:13:483
293252100,0sleep10-21swapper/122:23:151
1661299104,5cyclictest25705-21tr00:00:003
1661299103,2cyclictest21042-21tune2fs00:30:153
1661299102,2cyclictest6784-21ntp_kernel_err21:55:193
1660299102,4cyclictest4827-21munin-run20:55:000
30579290,0sleep10-21swapper/123:45:181
166129994,4cyclictest4460-21perl00:05:173
166129992,5cyclictest12252-21diskmemload22:54:073
166129992,4cyclictest2508-21sshd00:37:073
166129992,3cyclictest11532-21sensors_temp20:00:193
166129992,1cyclictest8534-21df_inode21:40:143
166129985,2cyclictest17918-21apt-get21:45:153
166129984,4cyclictest2844-21apt-get22:10:133
166129983,5cyclictest13509-21ssh22:31:033
166129983,3cyclictest4114-21rm22:59:543
166129983,3cyclictest31545-21smartctl20:40:183
166129983,2cyclictest14435-21python22:15:203
166129982,4cyclictest6830-21cat23:50:123
166129982,3cyclictest19117-21kworker/3:123:11:083
166129982,3cyclictest12252-21diskmemload21:25:473
166129982,2cyclictest26948-21ssh23:27:103
166129982,2cyclictest12252-21diskmemload23:40:083
166129982,1cyclictest28647-21ntp_states19:30:183
166029982,3cyclictest27118-21awk20:35:000
166129976,1cyclictest32341-21apt-get19:40:113
166129975,2cyclictest29093-21apt-get23:45:113
166129975,2cyclictest25108-21dpkg22:05:013
166129975,2cyclictest19685-21awk20:20:003
166129975,2cyclictest12195-21apt-get23:20:113
166129975,1cyclictest2387-21apt-get19:45:113
166129974,3cyclictest12252-21diskmemload23:00:103
166129974,3cyclictest12252-21diskmemload21:30:143
166129974,2cyclictest8047-21perl19:55:143
166129974,2cyclictest32591-21apt-get22:25:113
166129974,2cyclictest32563-21apt-get21:20:013
166129974,2cyclictest22741-21ssh22:20:123
166129974,2cyclictest22630-21ssh21:15:133
166129974,2cyclictest15266-21ssh22:00:123
166129974,2cyclictest13995-21sensors_temp20:05:163
166129973,3cyclictest27300-21cat19:30:003
166129972,4cyclictest12252-21diskmemload00:01:063
166129972,3cyclictest9784-21ssh00:24:523
166129972,3cyclictest30520-21ssh22:40:133
166129972,3cyclictest26375-21ssh22:37:583
166129972,3cyclictest25816-21cat20:30:153
166129972,3cyclictest21466-21python19:15:213
166129972,3cyclictest18330-21ssh00:29:033
166129972,3cyclictest16990-21ssh23:05:303
166129972,3cyclictest12252-21diskmemload22:46:193
166129972,3cyclictest12252-21diskmemload00:10:013
166129972,2cyclictest12252-21diskmemload23:15:283
166129972,2cyclictest12252-21diskmemload00:16:023
166129972,1cyclictest12252-21diskmemload21:50:143
166129965,1cyclictest5054-21apt-get20:55:103
166129964,2cyclictest7543-21apt21:00:083
166129964,2cyclictest32495-21apt20:45:133
166129964,2cyclictest30655-21grep21:35:133
166129964,2cyclictest22390-21apt-get20:25:103
166129964,2cyclictest20912-21irqstats20:20:153
166129964,2cyclictest17242-21diskstats19:10:133
166129963,3cyclictest22437-21apt19:20:113
166129963,2cyclictest5040-21cpuspeed19:50:123
166129963,2cyclictest27323-21chrt20:35:073
166129963,2cyclictest14955-21apt-get20:10:113
166129963,2cyclictest11289-21ntp_states21:05:203
166129963,2cyclictest0-21swapper/319:35:113
166129960,3cyclictest0-21swapper/323:30:013
166029962,4cyclictest12264-21munin-run21:10:000
166029960,3cyclictest29634-21awk19:35:010
166129953,2cyclictest2581-21munin-node20:50:113
166089955,0cyclictest12797-21apt-get21:10:132
166089950,5cyclictest31845-21rm23:45:462
166089950,5cyclictest25089-21ssh23:25:582
166089950,5cyclictest0-21swapper/200:37:252
166089950,0cyclictest0-21swapper/221:44:252
166089950,0cyclictest0-21swapper/200:13:082
166069952,2cyclictest0-21swapper/119:15:141
166069951,3cyclictest0-21swapper/119:20:121
166069951,2cyclictest0-21swapper/123:40:101
166069951,2cyclictest0-21swapper/123:25:121
166069951,2cyclictest0-21swapper/121:00:101
166069950,5cyclictest0-21swapper/120:00:321
166069950,5cyclictest0-21swapper/100:11:321
166029955,0cyclictest2012-21kworker/0:000:35:060
166029953,1cyclictest32311-21ssh23:30:130
166029950,5cyclictest0-21swapper/020:00:120
166029950,5cyclictest0-21swapper/019:20:110
32540240,1sleep032543-21cpuspeed19:40:120
166089944,0cyclictest0-21swapper/223:34:162
166089944,0cyclictest0-21swapper/222:20:572
166089943,1cyclictest12479-21/usr/sbin/munin20:05:122
166089942,1cyclictest9826-21cron21:25:012
166089941,2cyclictest0-21swapper/220:10:112
166089941,2cyclictest0-21swapper/219:55:102
166089940,4cyclictest30026-21apt-get20:40:102
166089940,4cyclictest25380-21apt-get22:05:122
166089940,4cyclictest23380-21irqstats20:25:152
166089940,4cyclictest21580-21ssh22:51:412
166089940,4cyclictest10002-21apt-get20:00:022
166089940,4cyclictest0-21swapper/223:40:112
166089940,4cyclictest0-21swapper/223:10:112
166089940,4cyclictest0-21swapper/223:05:112
166089940,4cyclictest0-21swapper/223:00:242
166089940,4cyclictest0-21swapper/222:01:162
166089940,4cyclictest0-21swapper/221:55:472
166089940,4cyclictest0-21swapper/200:30:112
166089940,4cyclictest0-21swapper/200:25:122
166089940,4cyclictest0-21swapper/200:22:122
166089940,4cyclictest0-21swapper/200:15:122
166089940,4cyclictest0-21swapper/200:08:012
166089940,4cyclictest0-21swapper/200:00:192
166089940,3cyclictest802-21snmpd23:15:372
166089940,3cyclictest19835-21grep20:20:002
166089940,3cyclictest10973-21ssh23:51:512
166089940,1cyclictest27936-21/usr/sbin/munin21:50:182
166089940,1cyclictest23201-21diskstats21:15:142
166089940,1cyclictest20537-21/usr/sbin/munin21:30:152
166089940,1cyclictest17752-21ntp_states23:55:152
166089940,1cyclictest0-21swapper/222:35:142
166089940,0cyclictest0-21swapper/222:42:372
166069944,0cyclictest0-21swapper/123:15:221
166069944,0cyclictest0-21swapper/122:52:231
166069944,0cyclictest0-21swapper/121:45:091
166069944,0cyclictest0-21swapper/121:23:111
166069944,0cyclictest0-21swapper/120:35:191
166069944,0cyclictest0-21swapper/100:03:141
166069941,2cyclictest0-21swapper/123:55:101
166069941,2cyclictest0-21swapper/123:10:111
166069941,2cyclictest0-21swapper/123:05:111
166069941,2cyclictest0-21swapper/122:30:021
166069941,2cyclictest0-21swapper/122:10:121
166069941,2cyclictest0-21swapper/122:05:131
166069941,2cyclictest0-21swapper/121:55:131
166069941,2cyclictest0-21swapper/121:15:121
166069941,2cyclictest0-21swapper/121:10:131
166069941,2cyclictest0-21swapper/121:05:141
166069941,2cyclictest0-21swapper/120:55:101
166069941,2cyclictest0-21swapper/120:40:101
166069941,2cyclictest0-21swapper/120:25:101
166069941,2cyclictest0-21swapper/120:20:101
166069941,2cyclictest0-21swapper/119:55:101
166069941,2cyclictest0-21swapper/119:10:111
166069941,2cyclictest0-21swapper/100:30:111
166069941,2cyclictest0-21swapper/100:05:141
166069941,1cyclictest0-21swapper/122:00:131
166069940,4cyclictest0-21swapper/123:30:041
166069940,4cyclictest0-21swapper/121:29:001
166069940,2cyclictest0-21swapper/122:15:111
166069940,0cyclictest0-21swapper/122:38:591
166069940,0cyclictest0-21swapper/121:34:511
166029942,2cyclictest24563-21ssh23:10:020
166029942,1cyclictest13083-21ssh21:42:180
166029941,3cyclictest12252-21diskmemload00:19:020
166029941,2cyclictest0-21swapper/019:25:120
166029940,4cyclictest30905-21ssh22:24:150
166029940,4cyclictest30357-21ssh22:07:120
166029940,4cyclictest0-21swapper/023:55:100
166029940,4cyclictest0-21swapper/023:50:350
166029940,4cyclictest0-21swapper/023:45:110
166029940,4cyclictest0-21swapper/023:20:110
166029940,4cyclictest0-21swapper/023:15:020
166029940,4cyclictest0-21swapper/022:35:120
166029940,4cyclictest0-21swapper/022:25:110
166029940,4cyclictest0-21swapper/022:19:140
166029940,4cyclictest0-21swapper/022:10:250
166029940,4cyclictest0-21swapper/021:55:130
166029940,4cyclictest0-21swapper/021:20:010
166029940,4cyclictest0-21swapper/021:12:470
166029940,4cyclictest0-21swapper/020:45:130
166029940,4cyclictest0-21swapper/020:40:020
166029940,4cyclictest0-21swapper/020:10:110
166029940,4cyclictest0-21swapper/019:55:110
166029940,4cyclictest0-21swapper/000:25:130
166029940,4cyclictest0-21swapper/000:20:110
166029940,3cyclictest6896-21users20:55:190
166029940,3cyclictest32093-21latency_hist19:40:000
166029940,3cyclictest28735-21/usr/sbin/munin21:50:170
166029940,3cyclictest26786-21df00:00:130
166029940,3cyclictest11571-21ssh00:09:080
166029940,3cyclictest10327-21apt-get22:30:120
166029940,3cyclictest0-21swapper/023:00:120
166029940,3cyclictest0-21swapper/000:30:120
166029940,1cyclictest19042-21munin-node19:15:000
166029940,0cyclictest0-21swapper/022:00:350
166089933,0cyclictest7467-21kworker/2:120:50:132
166089933,0cyclictest7403-21kworker/2:222:10:052
166089932,1cyclictest19805-21swap19:15:012
166089931,2cyclictest57150irq/125-eth021:35:072
166089931,1cyclictest0-21swapper/219:30:112
166089930,3cyclictest8165-21grep21:00:112
166089930,3cyclictest4856-21apt-get19:50:112
166089930,3cyclictest32673-21cat20:45:132
166089930,3cyclictest32425-21sh22:25:042
166089930,3cyclictest29847-21apt-get19:35:122
166089930,3cyclictest28321-21irqstats20:35:152
166089930,3cyclictest22439-21apt-get19:20:112
166089930,3cyclictest10235-21hddtemp_smartct23:35:132
166089930,3cyclictest10235-21hddtemp_smartct23:35:132
166089930,3cyclictest0-21swapper/223:20:032
166089930,3cyclictest0-21swapper/222:55:112
166089930,3cyclictest0-21swapper/222:45:042
166089930,3cyclictest0-21swapper/222:15:112
166089930,3cyclictest0-21swapper/221:45:012
166089930,3cyclictest0-21swapper/221:20:132
166089930,3cyclictest0-21swapper/221:05:062
166089930,3cyclictest0-21swapper/220:55:112
166089930,3cyclictest0-21swapper/220:30:122
166089930,3cyclictest0-21swapper/220:20:102
166089930,3cyclictest0-21swapper/219:25:112
166089930,3cyclictest0-21swapper/219:10:122
166089930,2cyclictest32329-21runrttasks19:40:042
166089930,2cyclictest0-21swapper/219:45:002
166069933,0cyclictest0-21swapper/122:44:051
166069932,1cyclictest0-21swapper/100:20:121
166069931,2cyclictest0-21swapper/119:40:111
166069931,1cyclictest0-21swapper/123:20:111
166069931,1cyclictest0-21swapper/122:45:121
166069931,1cyclictest0-21swapper/121:40:121
166069931,1cyclictest0-21swapper/120:50:101
166069931,1cyclictest0-21swapper/120:45:121
166069931,1cyclictest0-21swapper/120:30:111
166069931,1cyclictest0-21swapper/120:15:121
166069931,1cyclictest0-21swapper/120:05:091
166069931,1cyclictest0-21swapper/119:50:111
166069931,1cyclictest0-21swapper/119:45:121
166069931,1cyclictest0-21swapper/119:35:111
166069931,1cyclictest0-21swapper/100:35:121
166069930,3cyclictest0-21swapper/119:30:591
166069930,2cyclictest0-21swapper/122:25:121
166069930,2cyclictest0-21swapper/121:50:141
166069930,2cyclictest0-21swapper/121:35:131
166069930,1cyclictest0-21swapper/100:25:121
166029933,0cyclictest2012-21kworker/0:022:55:010
166029931,1cyclictest0-21swapper/020:20:110
166029930,3cyclictest22630-21ssh21:15:130
166029930,3cyclictest19508-21cut19:15:010
166029930,3cyclictest17872-21ssh21:45:120
166029930,3cyclictest17566-21ssh22:50:120
166029930,3cyclictest12252-21diskmemload23:40:100
166029930,3cyclictest0-21swapper/023:35:110
166029930,3cyclictest0-21swapper/023:35:110
166029930,3cyclictest0-21swapper/023:25:110
166029930,3cyclictest0-21swapper/023:05:070
166029930,3cyclictest0-21swapper/022:45:120
166029930,3cyclictest0-21swapper/021:35:120
166029930,3cyclictest0-21swapper/021:30:130
166029930,3cyclictest0-21swapper/021:25:010
166029930,3cyclictest0-21swapper/021:00:130
166029930,3cyclictest0-21swapper/020:35:110
166029930,3cyclictest0-21swapper/020:25:100
166029930,3cyclictest0-21swapper/020:15:130
166029930,3cyclictest0-21swapper/020:05:140
166029930,3cyclictest0-21swapper/019:50:120
166029930,3cyclictest0-21swapper/019:45:110
166029930,3cyclictest0-21swapper/000:10:100
166069921,1cyclictest270222chrt19:28:361
166069921,1cyclictest0-21swapper/123:35:101
166069921,1cyclictest0-21swapper/123:35:101
166069921,1cyclictest0-21swapper/100:15:131
166069920,2cyclictest6398-21taskset23:50:071
166069920,1cyclictest16857-21chrt20:10:521
166069920,1cyclictest0-21swapper/122:55:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional