You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 05:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Wed Dec 24, 2025 00:45:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1562021320,2sleep00-21swapper/019:40:180
1562021320,2sleep00-21swapper/019:40:180
1009721180,3sleep00-21swapper/000:25:090
1009721180,3sleep00-21swapper/000:25:090
3122921010,3sleep00-21swapper/021:25:580
3122921010,3sleep00-21swapper/021:25:580
300922990,2sleep026900-21kworker/0:022:31:360
313252930,3sleep30-21swapper/300:13:193
313252930,3sleep30-21swapper/300:13:193
132002890,3sleep30-21swapper/321:05:193
160292880,2sleep30-21swapper/323:57:193
160292880,2sleep30-21swapper/323:57:193
160292880,2sleep30-21swapper/323:57:193
311562850,3sleep00-21swapper/000:13:040
311562850,3sleep00-21swapper/000:13:040
284892810,3chrt0-21swapper/320:15:293
284892810,3chrt0-21swapper/320:15:293
196782790,3sleep00-21swapper/022:20:430
196782790,3sleep00-21swapper/022:20:430
198432760,3chrt0-21swapper/222:55:182
198432760,3chrt0-21swapper/222:55:182
163332760,3chrt0-21swapper/222:50:352
163332760,3chrt0-21swapper/222:50:352
310232730,3sleep00-21swapper/023:05:560
310232730,3sleep00-21swapper/023:05:560
245842710,4sleep30-21swapper/320:05:203
245842710,4sleep30-21swapper/320:05:203
233772710,3sleep20-21swapper/222:25:202
36122680,4sleep20-21swapper/222:38:062
36122680,4sleep20-21swapper/222:38:062
130192680,4sleep30-21swapper/323:54:583
130192680,4sleep30-21swapper/323:54:583
68842610,3sleep10-21swapper/100:20:481
68842610,3sleep10-21swapper/100:20:481
246872600,2sleep124738-21latency_hist00:40:061
246872600,2sleep124738-21latency_hist00:40:061
246872600,2sleep124738-21latency_hist00:40:061
27702590,3sleep30-21swapper/320:35:233
27702590,3sleep30-21swapper/320:35:233
59332580,5sleep00-21swapper/019:10:340
59332580,5sleep00-21swapper/019:10:340
66962570,3sleep30-21swapper/300:20:303
66962570,3sleep30-21swapper/300:20:303
233022570,3chrt0-21swapper/122:58:381
233022570,3chrt0-21swapper/122:58:381
319452560,2sleep231268-21/usr/sbin/munin22:00:242
104522560,3chrt0-21swapper/319:25:223
189522550,3sleep30-21swapper/300:00:253
189522550,3sleep30-21swapper/300:00:253
324742540,3sleep10-21swapper/123:40:341
324742540,3sleep10-21swapper/123:40:341
303642510,8sleep121-21ksoftirqd/120:20:291
303642510,8sleep121-21ksoftirqd/120:20:291
283252510,5sleep2131rcu_preempt00:10:202
283252510,5sleep2131rcu_preempt00:10:202
16412510,3chrt0-21swapper/300:15:283
16412510,3chrt0-21swapper/300:15:283
257162480,2sleep125727-21ssh23:34:441
252562470,3chrt0-21swapper/023:00:260
252562470,3chrt0-21swapper/023:00:260
192512470,3chrt0-21swapper/123:27:321
192512470,3chrt0-21swapper/123:27:321
14032470,3chrt0-21swapper/323:42:283
14032470,3chrt0-21swapper/323:42:283
134342470,5chrt0-21swapper/121:05:221
129882470,3sleep30-21swapper/322:15:003
129882470,3sleep30-21swapper/322:15:003
71882460,3chrt0-21swapper/200:21:132
71882460,3chrt0-21swapper/200:21:132
226802460,3chrt0-21swapper/221:17:402
226802460,3chrt0-21swapper/221:17:402
226802460,3chrt0-21swapper/221:17:402
223692460,4sleep10-21swapper/100:04:291
223692460,4sleep10-21swapper/100:04:291
136442460,3chrt0-21swapper/021:05:250
187572450,2chrt0-21swapper/119:50:071
187572450,2chrt0-21swapper/119:50:071
63542440,13sleep121-21ksoftirqd/121:34:351
63542440,13sleep121-21ksoftirqd/121:34:351
295532430,4sleep30-21swapper/322:30:513
100692430,4sleep30-21swapper/323:18:213
100692430,4sleep30-21swapper/323:18:213
303442420,3sleep20-21swapper/221:59:112
303442420,3sleep20-21swapper/221:59:112
305372410,3sleep30-21swapper/321:59:293
305372410,3sleep30-21swapper/321:59:293
132782410,4sleep30-21swapper/321:40:403
132782410,4sleep30-21swapper/321:40:403
598499401,6cyclictest23105-21ssh00:05:152
14472390,2sleep01460-21sh22:02:280
79902380,3sleep30-21swapper/322:09:493
79902380,3sleep30-21swapper/322:09:493
275672380,3sleep00-21swapper/023:35:300
275672380,3sleep00-21swapper/023:35:300
137952380,3sleep30-21swapper/300:28:343
67372360,1sleep06757-21/usr/sbin/munin23:15:180
67372360,1sleep06757-21/usr/sbin/munin23:15:180
598499361,7cyclictest2711-21needreboot21:30:242
598499361,7cyclictest2711-21needreboot21:30:242
598499360,7cyclictest7620-21sh23:15:272
598499360,7cyclictest7620-21sh23:15:272
247482360,3sleep20-21swapper/223:33:232
126302360,4sleep00-21swapper/021:40:250
126302360,4sleep00-21swapper/021:40:250
114372360,3chrt0-21swapper/023:52:460
114372360,3chrt0-21swapper/023:52:460
598499352,8cyclictest31193-21/usr/sbin/munin23:40:322
598499352,8cyclictest31193-21/usr/sbin/munin23:40:322
598499351,8cyclictest4193-21runrttasks22:05:242
598499351,8cyclictest4193-21runrttasks22:05:242
598499351,7cyclictest7682-21sed19:15:302
598499351,7cyclictest7682-21sed19:15:302
598499351,7cyclictest17481-21ssh23:25:262
598499351,7cyclictest17481-21ssh23:25:262
598499351,21cyclictest0-21swapper/200:32:042
598499351,21cyclictest0-21swapper/200:32:042
598499350,8cyclictest13360-21date22:15:152
284272350,2sleep00-21swapper/021:23:540
284272350,2sleep00-21swapper/021:23:540
203052350,3sleep020285-21ssh00:35:180
203052350,3sleep020285-21ssh00:35:180
203052350,3sleep020285-21ssh00:35:180
181002350,3sleep30-21swapper/322:20:103
181002350,3sleep30-21swapper/322:20:103
598499341,9cyclictest28380-21ntp_states20:15:272
598499341,9cyclictest28380-21ntp_states20:15:272
598499341,8cyclictest29800-21grep21:25:192
598499341,8cyclictest29800-21grep21:25:192
598499341,7cyclictest30177-21ntp_states20:20:272
598499341,7cyclictest30177-21ntp_states20:20:272
598499341,7cyclictest17119-21latency_hist19:45:132
598499341,7cyclictest17119-21latency_hist19:45:132
598499341,7cyclictest10442-21ssh21:38:272
598499341,7cyclictest10442-21ssh21:38:272
598499341,7cyclictest10442-21ssh21:38:272
598499341,10cyclictest22066-21grep21:50:222
598499340,7cyclictest4091-21ssh23:11:512
598499340,7cyclictest4091-21ssh23:11:512
598499340,6cyclictest12528-21ssh00:26:492
598499331,9cyclictest6441-21latency_hist19:15:102
598499331,9cyclictest6441-21latency_hist19:15:102
598499331,9cyclictest11164-21ssh23:52:242
598499331,9cyclictest11164-21ssh23:52:242
598499331,8cyclictest5154-21grep20:40:302
598499331,8cyclictest19440-21cat00:00:302
598499331,8cyclictest14769-21latency_hist21:10:142
598499331,8cyclictest14006-21irqstats19:35:202
598499331,8cyclictest14006-21irqstats19:35:202
598499331,7cyclictest14172-21ssh21:41:542
598499331,7cyclictest14172-21ssh21:41:542
598499331,6cyclictest10606-21users20:55:272
598499331,6cyclictest10606-21users20:55:272
598499331,6cyclictest10606-21users20:55:272
598499331,5cyclictest6105-21ssh23:47:112
598499331,5cyclictest6105-21ssh23:47:112
598499331,11cyclictest317-21grep22:35:132
598499331,10cyclictest14384-21ssh23:22:352
598499330,9cyclictest12062-21ssh22:13:422
598499330,7cyclictest20677-21ssh00:35:212
598499330,7cyclictest20677-21ssh00:35:212
598499330,7cyclictest20677-21ssh00:35:212
598499321,9cyclictest6877-21timerandwakeup20:45:272
598499321,9cyclictest6877-21timerandwakeup20:45:272
598499321,9cyclictest6877-21timerandwakeup20:45:272
598499321,9cyclictest1867-21ssh00:15:362
598499321,9cyclictest1867-21ssh00:15:362
598499321,8cyclictest29119-21ssh23:37:412
598499321,8cyclictest29119-21ssh23:37:412
598499321,8cyclictest17288-21ssh23:59:042
598499321,8cyclictest17288-21ssh23:59:042
598499321,8cyclictest17288-21ssh23:59:042
598499321,8cyclictest12299-21ssh22:46:442
598499321,7cyclictest23901-21/usr/sbin/munin00:05:282
598499321,7cyclictest23901-21/usr/sbin/munin00:05:282
598499321,10cyclictest30103-21ntpq23:05:242
598499321,10cyclictest30103-21ntpq23:05:242
598499320,8cyclictest10025-21sed19:25:112
598499320,8cyclictest10025-21sed19:25:112
598499320,7cyclictest20988-21sh22:22:332
598499320,7cyclictest20988-21sh22:22:332
253502320,2sleep025362-21rm00:06:500
253502320,2sleep025362-21rm00:06:500
123052320,3sleep10-21swapper/122:46:451
598499311,8cyclictest7711-21/usr/sbin/munin20:50:212
598499311,8cyclictest7711-21/usr/sbin/munin20:50:212
598499311,8cyclictest7711-21/usr/sbin/munin20:50:212
598499311,8cyclictest25449-21awk21:20:242
598499311,8cyclictest25449-21awk21:20:242
598499311,8cyclictest18943-21/usr/sbin/munin19:50:202
598499311,8cyclictest16121-21grep21:10:312
598499311,8cyclictest16121-21grep21:10:312
598499311,7cyclictest1806-21sshd20:30:372
598499311,7cyclictest1806-21sshd20:30:372
598499311,7cyclictest14524-21runrttasks22:15:292
598499311,7cyclictest14524-21runrttasks22:15:292
598499311,7cyclictest10388-21fschecks_time19:25:222
598499311,6cyclictest26943-21taskset23:02:032
598499311,6cyclictest26943-21taskset23:02:032
598499311,6cyclictest11991-21grep21:00:312
598499311,6cyclictest11991-21grep21:00:312
598499311,5cyclictest13367-21sshd19:34:372
598499311,5cyclictest13367-21sshd19:34:372
598499310,8cyclictest19150-21ssh21:47:042
598499310,8cyclictest19150-21ssh21:47:042
598499310,6cyclictest27197-21seq20:11:002
598499310,6cyclictest27197-21seq20:11:002
598499310,5cyclictest6063-21ntpq22:40:252
598499307,21cyclictest22973-21sed20:00:232
598499303,5cyclictest21617-21timerandwakeup19:55:282
598499303,5cyclictest21617-21timerandwakeup19:55:282
598499302,7cyclictest25257-21sed20:05:282
598499302,7cyclictest25257-21sed20:05:282
598499301,6cyclictest2399-21/usr/sbin/munin20:35:272
598499301,6cyclictest2399-21/usr/sbin/munin20:35:272
598499301,4cyclictest18094-21sed19:45:332
598499301,4cyclictest18094-21sed19:45:332
598499300,7cyclictest31417-21taskset20:25:192
205562300,3sleep00-21swapper/021:49:010
205562300,3sleep00-21swapper/021:49:010
160722300,2sleep10-21swapper/122:17:271
160722300,2sleep10-21swapper/122:17:271
248992290,3sleep10-21swapper/123:00:231
248992290,3sleep10-21swapper/123:00:231
5982992713,12cyclictest22949-21ssh23:30:530
55652270,3chrt0-21swapper/322:40:203
273202270,3chrt0-21swapper/322:29:313
261142270,3sleep30-21swapper/321:20:393
261142270,3sleep30-21swapper/321:20:393
196692270,3sleep30-21swapper/321:47:473
196692270,3sleep30-21swapper/321:47:473
33612260,2sleep03325-21latency_hist23:45:070
33612260,2sleep03325-21latency_hist23:45:070
253002260,4sleep30-21swapper/321:53:543
5983992412,10cyclictest28587-21ssh21:56:431
5983992412,10cyclictest28587-21ssh21:56:431
5982992416,6cyclictest8881-21ssh21:36:180
5982992416,6cyclictest8881-21ssh21:36:180
5982992416,6cyclictest8881-21ssh21:36:180
5982992413,9cyclictest11829-21ssh00:25:520
598299241,20cyclictest18262-21find22:20:170
598299241,20cyclictest18262-21find22:20:170
598299241,20cyclictest15196-21ls19:40:060
598299241,20cyclictest15196-21ls19:40:060
5982992411,10cyclictest1432-21switchtime22:35:290
5982992411,10cyclictest1432-21switchtime22:35:290
266472240,3chrt0-21swapper/120:10:291
266472240,3chrt0-21swapper/120:10:291
236592240,4sleep00-21swapper/022:59:090
236592240,4sleep00-21swapper/022:59:090
598299231,19cyclictest7879-21cut20:50:200
598299231,19cyclictest7879-21cut20:50:200
598299231,19cyclictest7879-21cut20:50:200
48722230,2sleep00-21swapper/021:32:330
48722230,2sleep00-21swapper/021:32:330
306232231,20sleep130634-21sh23:39:461
306232231,20sleep130634-21sh23:39:461
69032220,6sleep30-21swapper/319:15:223
69032220,6sleep30-21swapper/319:15:223
598399222,18cyclictest9259-21ls19:20:271
598399222,18cyclictest9259-21ls19:20:271
5983992211,9cyclictest13299-21ssh23:21:061
598399221,18cyclictest25719-21ls21:20:271
598399221,18cyclictest25719-21ls21:20:271
598399221,17cyclictest20899-21cut19:55:201
598399221,17cyclictest20899-21cut19:55:201
5983992211,10cyclictest12176-21ssh00:26:201
5983992210,10cyclictest17876-21ssh00:32:271
5983992210,10cyclictest17876-21ssh00:32:271
598299228,10cyclictest22463-21grep21:50:270
598299222,10cyclictest26984-21wc21:55:230
598299222,10cyclictest26984-21wc21:55:230
5982992215,5cyclictest15132-21ssh22:50:180
5982992215,5cyclictest15132-21ssh22:50:180
598299221,18cyclictest24750-21find21:20:170
598299221,18cyclictest24750-21find21:20:170
598299221,18cyclictest24750-21find21:20:170
598299221,12cyclictest695-21runrttasks22:41:560
56642222,11sleep14772-21/usr/sbin/munin19:10:311
56642222,11sleep14772-21/usr/sbin/munin19:10:311
598399213,5cyclictest7305-21perl21:35:201
598399213,5cyclictest7305-21perl21:35:201
598399213,5cyclictest7305-21perl21:35:201
5983992114,5cyclictest28058-21/usr/sbin/munin22:30:271
598399211,2cyclictest0-21swapper/100:19:231
598399211,2cyclictest0-21swapper/100:19:231
598399211,18cyclictest8843-21ls22:10:231
598399211,18cyclictest8843-21ls22:10:231
598399211,10cyclictest4395-21fschecks_time20:40:221
598399210,19cyclictest20875-21ls21:15:281
598399210,19cyclictest20875-21ls21:15:281
598399210,19cyclictest20875-21ls21:15:281
598299218,11cyclictest12995-21unixbench_singl19:30:290
598299218,11cyclictest12995-21unixbench_singl19:30:290
5982992115,4cyclictest14855-21ssh22:50:120
5982992113,5cyclictest738-21/usr/sbin/munin20:30:200
5982992113,5cyclictest738-21/usr/sbin/munin20:30:200
5982992112,6cyclictest0-21swapper/021:00:380
5982992112,6cyclictest0-21swapper/021:00:380
598299211,15cyclictest4193-21find20:40:200
598299211,10cyclictest13870-21seq23:55:230
598299211,10cyclictest13870-21seq23:55:230
598299211,10cyclictest13870-21seq23:55:230
5982992110,3cyclictest695-21runrttasks23:27:050
5982992110,3cyclictest695-21runrttasks23:27:050
269252210,3sleep10-21swapper/100:08:591
269252210,3sleep10-21swapper/100:08:591
598599201,12cyclictest0-21swapper/319:50:293
5983992013,5cyclictest10806-21ssh23:19:221
5983992013,5cyclictest10806-21ssh23:19:221
598399201,17cyclictest16991-21cut21:45:191
598399201,17cyclictest16991-21cut21:45:191
598399201,13cyclictest27960-21cut20:15:211
598399201,13cyclictest27960-21cut20:15:211
598399201,13cyclictest1876-21ls21:30:091
598399201,13cyclictest1876-21ls21:30:091
598399200,18cyclictest1063-21ls20:30:221
598399200,18cyclictest1063-21ls20:30:221
598299209,9cyclictest0-21swapper/023:46:180
598299209,9cyclictest0-21swapper/023:46:180
598299201,9cyclictest15789-21needreboot00:30:220
598299201,9cyclictest15789-21needreboot00:30:220
598299201,11cyclictest25229-21sh22:26:370
5982992010,8cyclictest9721-21ssh22:10:320
5982992010,8cyclictest9721-21ssh22:10:320
5982992010,8cyclictest6680-21df_inode19:15:200
5982992010,8cyclictest6680-21df_inode19:15:200
109022200,9sleep121-21ksoftirqd/119:25:281
598599191,13cyclictest0-21swapper/319:35:223
598599191,13cyclictest0-21swapper/319:35:223
598599191,12cyclictest0-21swapper/319:45:253
598599191,12cyclictest0-21swapper/319:45:253
598399192,8cyclictest11326-21cpuspeed21:00:221
598399192,8cyclictest11326-21cpuspeed21:00:221
5983991913,4cyclictest0-21swapper/123:55:281
5983991913,4cyclictest0-21swapper/123:55:281
5983991913,4cyclictest0-21swapper/123:55:281
5983991912,5cyclictest22506-21rm22:24:371
5983991912,5cyclictest22506-21rm22:24:371
5983991912,5cyclictest13971-21cat19:35:201
5983991912,5cyclictest13971-21cat19:35:201
598399191,15cyclictest15275-21irqstats21:10:221
598399191,15cyclictest15275-21irqstats21:10:221
598399191,15cyclictest12989-21unixbench_singl19:30:291
598399191,15cyclictest12989-21unixbench_singl19:30:291
598399191,11cyclictest695-21runrttasks20:35:181
598399191,11cyclictest695-21runrttasks20:35:181
598299199,7cyclictest470-21cups-browsed21:00:070
598299199,7cyclictest470-21cups-browsed21:00:070
598299199,7cyclictest470-21cups-browsed21:00:070
598299191,9cyclictest1114-21needreboot00:15:230
598299191,9cyclictest1114-21needreboot00:15:230
5982991912,5cyclictest0-21swapper/020:35:370
5982991912,5cyclictest0-21swapper/020:35:370
5982991911,6cyclictest0-21swapper/020:04:370
598299191,10cyclictest16199-21sh23:25:060
120982190,3sleep30-21swapper/322:46:263
598599181,13cyclictest0-21swapper/319:30:193
598599181,13cyclictest0-21swapper/319:30:193
598599181,12cyclictest0-21swapper/320:40:223
598399189,7cyclictest7989-21perl20:50:211
598399189,7cyclictest7989-21perl20:50:211
598399189,7cyclictest7989-21perl20:50:211
598399189,7cyclictest24878-21awk20:05:251
598399189,7cyclictest24878-21awk20:05:251
598399189,7cyclictest136-21systemd-journal21:42:231
598399189,7cyclictest136-21systemd-journal21:42:231
598399189,7cyclictest1003-21ls22:35:241
598399189,7cyclictest1003-21ls22:35:241
598399186,10cyclictest4857-21grep23:45:311
598399186,10cyclictest4857-21grep23:45:311
598399186,10cyclictest11384-21sh23:52:421
598399186,10cyclictest11384-21sh23:52:421
598399183,13cyclictest9703-21fschecks_time20:55:171
598399183,13cyclictest9703-21fschecks_time20:55:171
598399183,13cyclictest9703-21fschecks_time20:55:171
598399183,12cyclictest6216-21fschecks_time20:45:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional