You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 20:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Fri May 22, 2026 00:45:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2762921100,2sleep10-21swapper/122:34:491
2762921100,2sleep10-21swapper/122:34:491
2762921100,2sleep10-21swapper/122:34:491
2762921100,2sleep10-21swapper/122:34:491
1089421050,4sleep10-21swapper/122:15:071
1089421050,4sleep10-21swapper/122:15:071
138762870,3sleep10-21swapper/122:17:371
138762870,3sleep10-21swapper/122:17:371
314632810,3sleep10-21swapper/122:00:251
314632810,3sleep10-21swapper/122:00:251
314632810,3sleep10-21swapper/122:00:251
314932720,3chrt0-21swapper/100:30:231
229452720,5sleep30-21swapper/300:20:173
229452720,5sleep30-21swapper/300:20:173
123152700,3sleep10-21swapper/120:45:211
123152700,3sleep10-21swapper/120:45:211
280742670,4chrt0-21swapper/100:26:051
280742670,4chrt0-21swapper/100:26:051
136212630,3chrt0-21swapper/022:55:130
56262620,2chrt9871-21cyclictest22:09:371
56262620,2chrt9871-21cyclictest22:09:371
29492610,2sleep03089-21grep23:20:220
29492610,2sleep03089-21grep23:20:220
130972610,2chrt13100-21sed00:10:152
130972610,2chrt13100-21sed00:10:152
265282600,3chrt0-21swapper/200:25:142
205092600,4sleep10-21swapper/119:40:191
205092600,4sleep10-21swapper/119:40:191
92532580,3sleep00-21swapper/021:34:230
92532580,3sleep00-21swapper/021:34:230
325722580,3chrt0-21swapper/023:54:580
325722580,3chrt0-21swapper/023:54:580
325722580,3chrt0-21swapper/023:54:580
43362550,3chrt3862-21/usr/sbin/munin22:45:152
43362550,3chrt3862-21/usr/sbin/munin22:45:152
90242540,4chrt0-21swapper/221:33:572
90242540,4chrt0-21swapper/221:33:572
166032530,4sleep30-21swapper/319:30:173
57752520,3sleep20-21swapper/200:00:302
57752520,3sleep20-21swapper/200:00:302
57752520,3sleep20-21swapper/200:00:302
17532520,3sleep30-21swapper/320:20:013
17532520,3sleep30-21swapper/320:20:013
64102510,2sleep20-21swapper/220:30:202
64102510,2sleep20-21swapper/220:30:202
291802510,2sleep029189-21ssh00:28:100
291802510,2sleep029189-21ssh00:28:100
5192500,4chrt0-21swapper/323:17:393
5192500,4chrt0-21swapper/323:17:393
5192500,4chrt0-21swapper/323:17:393
177122500,2sleep20-21swapper/219:35:062
155082490,3sleep30-21swapper/320:55:163
155082490,3sleep30-21swapper/320:55:163
39692480,3sleep20-21swapper/220:25:132
39692480,3sleep20-21swapper/220:25:132
29022480,2sleep30-21swapper/322:43:593
29022480,2sleep30-21swapper/322:43:593
223922480,3sleep10-21swapper/123:41:001
223922480,3sleep10-21swapper/123:41:001
223922480,3sleep10-21swapper/123:41:001
9872994624,17cyclictest4214-21latency_hist00:00:050
9872994624,17cyclictest4214-21latency_hist00:00:050
9872994624,17cyclictest4214-21latency_hist00:00:050
9872994624,17cyclictest4214-21latency_hist00:00:050
281392460,4sleep30-21swapper/323:49:143
281392460,4sleep30-21swapper/323:49:143
221362450,9sleep333-21ksoftirqd/322:27:073
221362450,9sleep333-21ksoftirqd/322:27:073
221362450,9sleep333-21ksoftirqd/322:27:073
149522450,2sleep2261rcuc/223:34:022
149522450,2sleep2261rcuc/223:34:022
308982440,2sleep030431-21/usr/sbin/munin23:15:150
308982440,2sleep030431-21/usr/sbin/munin23:15:150
308982440,2sleep030431-21/usr/sbin/munin23:15:150
201292440,4chrt33-21ksoftirqd/322:25:143
201292440,4chrt33-21ksoftirqd/322:25:143
182992440,3sleep00-21swapper/000:15:190
182992440,3sleep00-21swapper/000:15:190
312382430,3sleep20-21swapper/223:52:262
312382430,3sleep20-21swapper/223:52:262
312382430,3sleep20-21swapper/223:52:262
131782430,3sleep00-21swapper/023:31:260
131782430,3sleep00-21swapper/023:31:260
58642420,3sleep20-21swapper/200:40:052
58642420,3sleep20-21swapper/200:40:052
58642420,3sleep20-21swapper/200:40:052
9873994120,15cyclictest4316-21latency_hist00:00:051
9873994120,15cyclictest4316-21latency_hist00:00:051
9873994120,15cyclictest4316-21latency_hist00:00:051
9873994120,15cyclictest4316-21latency_hist00:00:051
98242410,2sleep08367-21ls19:10:340
98242410,2sleep08367-21ls19:10:340
210022410,4sleep30-21swapper/323:03:003
210022410,4sleep30-21swapper/323:03:003
208682410,3sleep20-21swapper/223:40:132
208682410,3sleep20-21swapper/223:40:132
208682410,3sleep20-21swapper/223:40:132
157452410,3sleep10-21swapper/123:35:051
157452410,3sleep10-21swapper/123:35:051
118502410,3sleep30-21swapper/322:53:033
118502410,3sleep30-21swapper/322:53:033
326772400,3chrt0-21swapper/221:22:402
326772400,3chrt0-21swapper/221:22:402
987399383,26cyclictest4434-21/usr/sbin/munin00:00:211
987399383,26cyclictest4434-21/usr/sbin/munin00:00:211
987399383,26cyclictest4434-21/usr/sbin/munin00:00:211
987299382,16cyclictest5284-21open_files00:00:210
987299382,16cyclictest5284-21open_files00:00:210
987299382,16cyclictest5284-21open_files00:00:210
241132380,3sleep00-21swapper/000:21:140
241132380,3sleep00-21swapper/000:21:140
214182380,2sleep10-21swapper/100:19:061
214182380,2sleep10-21swapper/100:19:061
169832380,2sleep30-21swapper/321:00:143
169832380,2sleep30-21swapper/321:00:143
111492380,3sleep30-21swapper/300:08:113
111492380,3sleep30-21swapper/300:08:113
987499373,27cyclictest4346-21sed00:00:072
987499373,27cyclictest4346-21sed00:00:072
987499373,27cyclictest4346-21sed00:00:072
987499373,27cyclictest4346-21sed00:00:072
253742370,2sleep025447-21tail23:45:180
253742370,2sleep025447-21tail23:45:180
97392365,20sleep10-21swapper/119:10:261
97392365,20sleep10-21swapper/119:10:261
320072360,2sleep20-21swapper/200:30:532
212422360,2sleep021303-21ssh21:10:210
212422360,2sleep021303-21ssh21:10:210
111482360,3sleep20-21swapper/222:52:022
111482360,3sleep20-21swapper/222:52:022
243162340,2sleep124492-21unixbench_multi19:50:211
243162340,2sleep124492-21unixbench_multi19:50:211
191322340,4chrt0-21swapper/321:05:173
191322340,4chrt0-21swapper/321:05:173
191322340,4chrt0-21swapper/321:05:173
160162340,3sleep30-21swapper/300:13:173
160162340,3sleep30-21swapper/300:13:173
119632340,3sleep20-21swapper/200:09:222
119632340,3sleep20-21swapper/200:09:222
299882320,3sleep30-21swapper/320:05:213
299882320,3sleep30-21swapper/320:05:213
173252320,2sleep20-21swapper/222:20:432
173252320,2sleep20-21swapper/222:20:432
173252320,2sleep20-21swapper/222:20:432
248642310,2sleep20-21swapper/221:14:572
248642310,2sleep20-21swapper/221:14:572
231232310,3sleep223121-21ssh00:20:202
194112310,3sleep30-21swapper/321:45:363
194112310,3sleep30-21swapper/321:45:363
987599301,23cyclictest4349-21chrt00:00:073
987599301,23cyclictest4349-21chrt00:00:073
987599301,23cyclictest4349-21chrt00:00:073
987599301,23cyclictest4349-21chrt00:00:073
98262304,18sleep28367-21ls19:10:362
98262304,18sleep28367-21ls19:10:362
55432300,2sleep05553-21rm00:39:400
55432300,2sleep05553-21rm00:39:400
55432300,2sleep05553-21rm00:39:400
317622300,4sleep30-21swapper/322:00:593
317622300,4sleep30-21swapper/322:00:593
317622300,4sleep30-21swapper/322:00:593
314362290,1sleep131444-21diskmemload23:52:511
314362290,1sleep131444-21diskmemload23:52:511
314362290,1sleep131444-21diskmemload23:52:511
293702290,3sleep00-21swapper/021:59:070
293702290,3sleep00-21swapper/021:59:070
987499287,5cyclictest0-21swapper/221:39:102
987499287,5cyclictest0-21swapper/221:39:102
987499280,11cyclictest19542-21ssh00:16:242
987499280,11cyclictest19542-21ssh00:16:242
56262280,2sleep00-21swapper/020:30:090
56262280,2sleep00-21swapper/020:30:090
175592280,3sleep20-21swapper/223:35:512
175592280,3sleep20-21swapper/223:35:512
987499271,12cyclictest29487-21ssh21:19:322
987499271,12cyclictest29487-21ssh21:19:322
987499271,11cyclictest9198-21ssh23:27:402
987499271,11cyclictest9198-21ssh23:27:402
9872992714,10cyclictest17201-21irqstats21:00:160
9872992714,10cyclictest17201-21irqstats21:00:160
94502272,15sleep30-21swapper/319:10:243
94502272,15sleep30-21swapper/319:10:243
309762270,2sleep10-21swapper/123:15:161
309762270,2sleep10-21swapper/123:15:161
309762270,2sleep10-21swapper/123:15:161
19882270,3chrt0-21swapper/223:20:072
19882270,3chrt0-21swapper/223:20:072
19882270,3chrt0-21swapper/223:20:072
151592270,2sleep10-21swapper/100:12:031
151592270,2sleep10-21swapper/100:12:031
987499261,10cyclictest1621-21ssh22:41:342
987499261,10cyclictest1621-21ssh22:41:342
301182260,2sleep130113-21ssh21:20:101
263772260,3chrt0-21swapper/123:45:541
263772260,3chrt0-21swapper/123:45:541
191812260,4sleep10-21swapper/123:00:211
191812260,4sleep10-21swapper/123:00:211
987499258,4cyclictest0-21swapper/221:50:532
987499258,4cyclictest0-21swapper/221:50:532
987499257,4cyclictest0-21swapper/221:46:332
987499257,4cyclictest0-21swapper/221:46:332
987499257,10cyclictest0-21swapper/220:44:362
987499257,10cyclictest0-21swapper/220:44:362
987499253,6cyclictest20724-21ps22:25:212
987499253,6cyclictest20724-21ps22:25:212
987499253,6cyclictest20724-21ps22:25:212
987499252,8cyclictest7824-21ssh22:10:482
987499252,8cyclictest7824-21ssh22:10:482
987499252,8cyclictest31063-21ssh22:38:402
987499252,8cyclictest31063-21ssh22:38:402
987499252,8cyclictest31063-21ssh22:38:402
324432250,3sleep20-21swapper/220:15:042
324432250,3sleep20-21swapper/220:15:042
254432250,3sleep30-21swapper/323:08:433
254432250,3sleep30-21swapper/323:08:433
987499248,4cyclictest0-21swapper/220:50:102
987499248,4cyclictest0-21swapper/220:50:102
987499243,5cyclictest27-21ksoftirqd/223:20:202
987499243,5cyclictest27-21ksoftirqd/223:20:202
987499240,9cyclictest19469-21cat23:00:232
987499240,9cyclictest19469-21cat23:00:232
987499240,11cyclictest29233-21ssh23:13:132
987499240,11cyclictest29233-21ssh23:13:132
987499240,11cyclictest29233-21ssh23:13:132
987499240,10cyclictest3325-21ssh21:25:482
987499240,10cyclictest3325-21ssh21:25:482
987499240,10cyclictest3325-21ssh21:25:482
987399246,3cyclictest131rcu_preempt00:10:021
987399246,3cyclictest131rcu_preempt00:10:021
9873992416,6cyclictest13424-21ssh21:39:391
9873992416,6cyclictest13424-21ssh21:39:391
987399241,20cyclictest24212-21grep22:30:141
987399241,20cyclictest24212-21grep22:30:141
9872992416,5cyclictest16718-21ssh23:35:210
9872992416,5cyclictest16718-21ssh23:35:210
987299241,19cyclictest2166-21ls22:05:140
9872992411,10cyclictest16598-21needreboot19:30:170
987299240,20cyclictest15034-21fschecks_count20:55:130
987299240,20cyclictest15034-21fschecks_count20:55:130
56082240,3chrt0-21swapper/320:30:083
56082240,3chrt0-21swapper/320:30:083
253452240,3chrt0-21swapper/222:30:322
253452240,3chrt0-21swapper/222:30:322
253452240,3chrt0-21swapper/222:30:322
253452240,3chrt0-21swapper/222:30:322
252472240,2sleep1201rcuc/123:08:211
252472240,2sleep1201rcuc/123:08:211
125922240,3sleep30-21swapper/321:38:043
125922240,3sleep30-21swapper/321:38:043
987499234,6cyclictest27-21ksoftirqd/222:15:162
987499234,6cyclictest27-21ksoftirqd/222:15:162
987499234,6cyclictest27-21ksoftirqd/220:15:212
987499234,6cyclictest27-21ksoftirqd/220:15:212
987499232,8cyclictest17409-21ssh21:44:262
987499232,8cyclictest17409-21ssh21:44:262
987499232,6cyclictest27-21ksoftirqd/222:55:422
987499231,7cyclictest3195-21ssh22:05:362
987499231,7cyclictest3195-21ssh22:05:362
987499231,17cyclictest30911-21ssh22:00:202
987499231,17cyclictest30911-21ssh22:00:202
987499231,17cyclictest30911-21ssh22:00:202
9873992315,6cyclictest16944-21ssh21:43:351
9873992315,6cyclictest16944-21ssh21:43:351
987399230,20cyclictest19083-21ls21:45:221
987399230,20cyclictest19083-21ls21:45:221
987299231,3cyclictest0-21swapper/023:26:180
987299231,3cyclictest0-21swapper/023:26:180
9872992311,9cyclictest9622-21which22:50:210
9872992311,9cyclictest9622-21which22:50:210
987299231,19cyclictest6772-21grep20:30:220
987299231,19cyclictest6772-21grep20:30:220
987299231,19cyclictest31271-21ls22:00:230
987299231,19cyclictest31271-21ls22:00:230
273582230,3sleep10-21swapper/121:55:261
273582230,3sleep10-21swapper/121:55:261
234132230,3chrt23412-21awk00:20:231
234132230,3chrt23412-21awk00:20:231
213552230,2sleep00-21swapper/021:49:140
213552230,2sleep00-21swapper/021:49:140
987499229,4cyclictest0-21swapper/223:08:102
987499229,4cyclictest0-21swapper/223:08:102
987499226,5cyclictest27-21ksoftirqd/200:25:152
987499226,5cyclictest27-21ksoftirqd/200:25:152
987499220,8cyclictest27505-21ssh23:48:022
987499220,8cyclictest27505-21ssh23:48:022
987499220,17cyclictest12688-21ls19:20:142
987499220,17cyclictest12688-21ls19:20:142
987499220,17cyclictest12688-21ls19:20:142
987399229,10cyclictest17666-21grep21:00:221
987399229,10cyclictest17666-21grep21:00:221
987399222,17cyclictest674-21snmpd19:35:141
987399222,17cyclictest674-21snmpd19:35:141
987399222,16cyclictest9467-21ssh22:50:201
987399222,16cyclictest9467-21ssh22:50:201
987299229,11cyclictest3678-21cat20:25:030
987299229,11cyclictest3678-21cat20:25:030
987299229,11cyclictest3678-21cat20:25:030
9872992214,5cyclictest944-21/usr/sbin/munin20:15:210
9872992214,5cyclictest944-21/usr/sbin/munin20:15:210
987299221,15cyclictest8950-21taskset00:05:210
987299221,15cyclictest8950-21taskset00:05:210
987299221,12cyclictest8648-21latency_hist22:50:100
987499218,4cyclictest0-21swapper/219:46:342
987499218,4cyclictest0-21swapper/219:46:342
987499216,8cyclictest0-21swapper/219:15:592
987499213,6cyclictest0-21swapper/219:54:412
987499213,6cyclictest0-21swapper/219:54:412
9874992113,6cyclictest27153-21/usr/sbin/munin20:00:112
9874992113,6cyclictest27153-21/usr/sbin/munin20:00:112
9874992113,6cyclictest27153-21/usr/sbin/munin20:00:112
987499210,8cyclictest28481-21ssh21:57:282
987499210,8cyclictest28481-21ssh21:57:282
9873992114,5cyclictest1270-21ssh21:24:331
9873992114,5cyclictest1270-21ssh21:24:331
9873992113,6cyclictest3113-21vmstat21:25:241
9873992113,6cyclictest3113-21vmstat21:25:241
9873992113,6cyclictest3113-21vmstat21:25:241
987399211,14cyclictest10546-21ls19:15:121
987299216,12cyclictest22337-21sendmail_mailqu19:45:210
987299216,12cyclictest22337-21sendmail_mailqu19:45:210
987299211,9cyclictest6483-21fschecks_time22:10:140
987299211,9cyclictest6483-21fschecks_time22:10:140
9872992115,4cyclictest20838-21ssh23:40:120
9872992115,4cyclictest20838-21ssh23:40:120
9872992115,4cyclictest20838-21ssh23:40:120
9872992113,5cyclictest28364-21grep22:35:150
9872992113,5cyclictest28364-21grep22:35:150
9872992113,5cyclictest28364-21grep22:35:150
987299211,17cyclictest30896-21fschecks_count20:10:120
987299211,17cyclictest30896-21fschecks_count20:10:120
9872992110,7cyclictest23487-21cat23:05:230
9872992110,7cyclictest23487-21cat23:05:230
987299210,16cyclictest7763-21cut20:35:120
987299210,16cyclictest7763-21cut20:35:120
219492210,4sleep30-21swapper/300:19:523
219492210,4sleep30-21swapper/300:19:523
987599201,17cyclictest0-21swapper/321:25:123
987599201,17cyclictest0-21swapper/321:25:123
987499209,3cyclictest0-21swapper/221:07:402
987499209,3cyclictest0-21swapper/221:07:402
987499209,3cyclictest0-21swapper/221:07:402
987499208,9cyclictest17930-21df_inode19:35:122
987499208,9cyclictest17930-21df_inode19:35:122
987499205,3cyclictest0-21swapper/220:22:382
987499205,3cyclictest0-21swapper/220:22:382
987499205,3cyclictest0-21swapper/220:22:382
987499202,5cyclictest27-21ksoftirqd/219:30:122
987499201,5cyclictest27-21ksoftirqd/220:55:222
987499201,5cyclictest27-21ksoftirqd/220:55:222
9873992013,5cyclictest15439-21ssh22:56:181
9873992012,5cyclictest5256-21ssh00:39:051
9873992012,5cyclictest5256-21ssh00:39:051
9873992012,5cyclictest5256-21ssh00:39:051
987399201,16cyclictest27414-21switchtime23:10:211
987399201,16cyclictest27414-21switchtime23:10:211
987399201,16cyclictest27414-21switchtime23:10:211
9873992011,6cyclictest0-21swapper/120:20:121
9873992011,6cyclictest0-21swapper/120:20:121
9873992011,6cyclictest0-21swapper/120:20:121
987399201,13cyclictest17662-21ls19:35:041
987399201,12cyclictest25574-21ls19:55:151
987399201,12cyclictest25574-21ls19:55:151
987299209,9cyclictest0-21swapper/021:52:470
987299209,9cyclictest0-21swapper/021:52:470
987299205,12cyclictest663-21lldpd00:35:040
987299202,7cyclictest12-21ksoftirqd/023:00:170
987299202,7cyclictest12-21ksoftirqd/023:00:170
987299201,9cyclictest20666-21ntp_states22:25:200
987299201,9cyclictest20666-21ntp_states22:25:200
987299201,9cyclictest20666-21ntp_states22:25:200
987299201,8cyclictest20257-21latency_hist21:10:030
987299201,8cyclictest20257-21latency_hist21:10:030
987299201,8cyclictest20257-21latency_hist21:10:030
9872992014,4cyclictest11403-21ssh21:35:490
9872992014,4cyclictest11403-21ssh21:35:490
9872992013,4cyclictest14091-21ssh00:10:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional