You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 20:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Thu Dec 11, 2025 12:45:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2808921680,4sleep128053-21sendmail_mailtr09:31:221
2808921680,4sleep128053-21sendmail_mailtr09:31:221
2450221450,2sleep20-21swapper/210:06:202
2450221450,2sleep20-21swapper/210:06:202
1365821390,2sleep10-21swapper/111:50:401
1365821390,2sleep10-21swapper/111:50:401
3101321340,3sleep131014-21ssh09:36:121
3101321340,3sleep131014-21ssh09:36:121
203432850,2sleep20-21swapper/210:40:522
203432850,2sleep20-21swapper/210:40:522
214932750,3sleep10-21swapper/111:59:241
214932750,3sleep10-21swapper/111:59:241
62282710,3sleep10-21swapper/112:19:331
62282710,3sleep10-21swapper/112:19:331
163802700,3sleep20-21swapper/211:53:062
51662690,3sleep10-21swapper/110:21:301
51662690,3sleep10-21swapper/110:21:301
165152680,3sleep20-21swapper/209:56:352
165152680,3sleep20-21swapper/209:56:352
115662680,3chrt0-21swapper/107:46:171
115662680,3chrt0-21swapper/107:46:171
265062580,1sleep333-21ksoftirqd/310:08:503
265062580,1sleep333-21ksoftirqd/310:08:503
246642570,3sleep20-21swapper/208:21:142
246642570,3sleep20-21swapper/208:21:142
30482560,3sleep10-21swapper/108:51:111
30482560,3sleep10-21swapper/108:51:111
205542550,3sleep30-21swapper/308:11:113
205542550,3sleep30-21swapper/308:11:113
310362530,2sleep129968-21ls07:11:221
310362530,2sleep129968-21ls07:11:221
26712530,3sleep30-21swapper/311:36:273
26712530,3sleep30-21swapper/311:36:273
88042500,8sleep333-21ksoftirqd/311:44:273
88042500,8sleep333-21ksoftirqd/311:44:273
289022500,4sleep30-21swapper/312:07:423
289022500,4sleep30-21swapper/312:07:423
3147299491,4cyclictest0-21swapper/012:21:110
3147299491,4cyclictest0-21swapper/012:21:110
251022460,3chrt0-21swapper/108:21:211
251022460,3chrt0-21swapper/108:21:211
184232460,3chrt0-21swapper/109:20:331
184232460,3chrt0-21swapper/109:20:331
31472994415,24cyclictest151rcuc/010:26:140
314222440,2sleep029968-21ls07:11:290
314222440,2sleep029968-21ls07:11:290
46872430,2sleep30-21swapper/308:56:033
46872430,2sleep30-21swapper/308:56:033
3147299420,10cyclictest10981-21find11:46:240
3147299420,10cyclictest10981-21find11:46:240
177802420,4sleep00-21swapper/009:19:270
177802420,4sleep00-21swapper/009:19:270
162092420,3chrt0-21swapper/309:16:453
162092420,3chrt0-21swapper/309:16:453
49532410,3sleep30-21swapper/308:56:163
49532410,3sleep30-21swapper/308:56:163
317632410,3sleep00-21swapper/010:54:000
317632410,3sleep00-21swapper/010:54:000
3147299401,35cyclictest3989-21fschecks_count10:21:130
3147299401,35cyclictest3989-21fschecks_count10:21:130
274442400,2sleep30-21swapper/308:29:153
274442400,2sleep30-21swapper/308:29:153
17312400,2sleep30-21swapper/312:14:333
17312400,2sleep30-21swapper/312:14:333
314242390,2sleep229968-21ls07:11:312
314242390,2sleep229968-21ls07:11:312
3147299380,6cyclictest5742-21find08:56:250
3147299380,6cyclictest5742-21find08:56:250
3147299380,35cyclictest12530-21chrt09:51:590
3147299380,35cyclictest12530-21chrt09:51:590
314562380,4sleep012-21ksoftirqd/010:15:260
314562380,4sleep012-21ksoftirqd/010:15:260
314562380,4sleep012-21ksoftirqd/010:15:260
3147299371,9cyclictest253042ssh12:38:220
3147299371,9cyclictest253042ssh12:38:220
3147299371,9cyclictest253042ssh12:38:220
3147299371,9cyclictest18674-21fschecks_count08:06:100
3147299371,9cyclictest18674-21fschecks_count08:06:100
3147299371,4cyclictest2033-21ssh12:15:020
3147299371,4cyclictest2033-21ssh12:15:020
3147299370,9cyclictest16739-21fschecks_count08:01:120
3147299370,6cyclictest28179-21find09:31:230
3147299370,6cyclictest28179-21find09:31:230
3147299361,7cyclictest8510-21latency_hist09:06:060
3147299361,7cyclictest8510-21latency_hist09:06:060
3147299361,4cyclictest13185-21find10:31:230
3147299361,4cyclictest13185-21find10:31:230
3147299361,2cyclictest73-21kswapd009:11:130
3147299361,2cyclictest73-21kswapd008:41:130
3147299360,5cyclictest26004-21find10:46:220
3147299360,5cyclictest26004-21find10:46:220
3147299360,3cyclictest73-21kswapd011:26:120
3147299360,3cyclictest73-21kswapd011:26:120
3147299360,3cyclictest73-21kswapd011:26:120
3147299360,3cyclictest73-21kswapd008:26:130
3147299360,3cyclictest73-21kswapd008:26:130
3147299354,28cyclictest16932-21cut10:36:150
3147299354,28cyclictest16932-21cut10:36:150
3147299351,7cyclictest24009-21find09:26:220
3147299351,7cyclictest24009-21find09:26:220
3147299351,6cyclictest21160-21ssh10:02:120
3147299351,6cyclictest20244-21ssh09:21:230
3147299351,4cyclictest30400-21ntp_states08:36:190
3147299351,4cyclictest30400-21ntp_states08:36:190
3147299351,3cyclictest73-21kswapd012:01:130
3147299351,31cyclictest23302-21ssh10:43:370
3147299351,31cyclictest23302-21ssh10:43:370
31472993510,22cyclictest1368-21ssh09:39:250
31472993510,22cyclictest1368-21ssh09:39:250
3147299350,6cyclictest27858-21find12:06:240
3147299350,6cyclictest27858-21find12:06:240
3147299350,6cyclictest18599-21/usr/sbin/munin11:16:390
3147299350,6cyclictest18599-21/usr/sbin/munin11:16:390
3147299350,5cyclictest15113-21find11:51:220
3147299350,4cyclictest1655-21find10:56:210
3147299350,4cyclictest1655-21find10:56:210
3147299350,3cyclictest73-21kswapd009:06:120
3147299350,3cyclictest73-21kswapd009:06:120
274022350,3sleep10-21swapper/111:27:211
274022350,3sleep10-21swapper/111:27:211
274022350,3sleep10-21swapper/111:27:211
19252350,2sleep121-21ksoftirqd/112:14:511
19252350,2sleep121-21ksoftirqd/112:14:511
90702340,3chrt0-21swapper/011:44:560
90702340,3chrt0-21swapper/011:44:560
3147299345,26cyclictest27079-21ssh10:09:530
3147299345,26cyclictest27079-21ssh10:09:530
3147299341,9cyclictest25364-21users08:21:230
3147299341,9cyclictest25364-21users08:21:230
3147299341,8cyclictest3984-21timerandwakeup12:16:220
3147299341,8cyclictest3984-21timerandwakeup12:16:220
3147299341,8cyclictest15378-21ntp_states07:56:190
3147299341,7cyclictest9961-21ntpq11:06:170
3147299341,7cyclictest20988-21nfs4_client08:11:150
3147299341,7cyclictest20988-21nfs4_client08:11:150
3147299341,5cyclictest542-21snmpd07:18:590
3147299341,5cyclictest542-21snmpd07:18:590
3147299341,29cyclictest0-21swapper/008:16:120
3147299341,29cyclictest0-21swapper/008:16:120
3147299341,10cyclictest5051-21cpuspeed11:01:100
3147299341,10cyclictest5051-21cpuspeed11:01:100
3147299340,6cyclictest3622-21find09:41:210
3147299340,6cyclictest3622-21find09:41:210
3147299340,4cyclictest73-21kswapd008:46:120
3147299340,4cyclictest73-21kswapd008:46:120
3147299340,3cyclictest73-21kswapd008:31:110
3147299340,3cyclictest73-21kswapd008:31:110
3147299340,3cyclictest30916-21find11:31:220
3147299340,3cyclictest30916-21find11:31:220
3147299340,3cyclictest13765-21find07:51:210
3147299340,3cyclictest13765-21find07:51:210
3147299340,2cyclictest0-21swapper/012:26:140
301812340,4sleep30-21swapper/309:35:273
301812340,4sleep30-21swapper/309:35:273
122632340,3sleep30-21swapper/309:51:293
122632340,3sleep30-21swapper/309:51:293
3147299331,8cyclictest14901-21grep11:11:240
3147299331,8cyclictest14901-21grep11:11:240
3147299331,6cyclictest3094-21sh10:20:210
3147299331,3cyclictest0-21swapper/007:36:210
3147299331,3cyclictest0-21swapper/007:36:210
3147299331,2cyclictest0-21swapper/012:00:280
3147299331,2cyclictest0-21swapper/012:00:280
3147299331,28cyclictest6921-21fschecks_count09:46:130
3147299331,28cyclictest6921-21fschecks_count09:46:130
3147299331,28cyclictest0-21swapper/012:31:110
3147299331,28cyclictest0-21swapper/012:31:110
151702330,3sleep20-21swapper/212:28:232
115252330,3sleep1201rcuc/112:25:201
115252330,3sleep1201rcuc/112:25:201
3147299329,21cyclictest12249-21seq07:47:170
3147299329,21cyclictest12249-21seq07:47:170
3147299321,8cyclictest2169-21ntp_states11:36:220
3147299321,8cyclictest2169-21ntp_states11:36:220
3147299321,7cyclictest9872-21sendmail_mailtr07:41:200
3147299321,7cyclictest9872-21sendmail_mailtr07:41:200
3147299321,6cyclictest4769-21sshd07:27:260
3147299321,4cyclictest2520-21find07:21:210
3147299321,4cyclictest2520-21find07:21:210
3147299321,4cyclictest16149-21ssh09:56:220
3147299321,4cyclictest16149-21ssh09:56:220
3147299321,3cyclictest73-21kswapd011:21:120
207502320,2sleep30-21swapper/311:20:363
207502320,2sleep30-21swapper/311:20:363
160902320,3sleep30-21swapper/311:13:243
160902320,3sleep30-21swapper/311:13:243
81702310,3sleep20-21swapper/209:46:392
81702310,3sleep20-21swapper/209:46:392
31473993114,9cyclictest131rcu_preempt09:11:131
3147299311,9cyclictest3738-21sendmail_mailqu08:51:200
3147299311,9cyclictest3738-21sendmail_mailqu08:51:200
3147299311,8cyclictest5725-21cut07:31:140
308042310,2sleep230819-21ssh10:52:222
308042310,2sleep230819-21ssh10:52:222
245822310,3sleep30-21swapper/309:26:543
245822310,3sleep30-21swapper/309:26:543
323372300,4sleep30-21swapper/310:55:093
323372300,4sleep30-21swapper/310:55:093
233102300,3sleep227-21ksoftirqd/211:22:402
184102300,3sleep30-21swapper/309:59:493
184102300,3sleep30-21swapper/309:59:493
3147499281,4cyclictest131rcu_preempt09:21:122
295572270,3sleep30-21swapper/311:30:573
295572270,3sleep30-21swapper/311:30:573
295572270,3sleep30-21swapper/311:30:573
269932270,3sleep20-21swapper/212:40:442
269932270,3sleep20-21swapper/212:40:442
269932270,3sleep20-21swapper/212:40:442
236902270,3sleep10-21swapper/108:19:121
236902270,3sleep10-21swapper/108:19:121
205282270,3sleep30-21swapper/310:01:223
124852270,3sleep10-21swapper/111:09:361
320542260,3chrt0-21swapper/310:16:093
76582250,2sleep20-21swapper/212:21:112
76582250,2sleep20-21swapper/212:21:112
3147399253,19cyclictest21497-21grep08:11:221
3147399253,19cyclictest21497-21grep08:11:221
3147399251,3cyclictest131rcu_preempt10:16:121
31473992513,10cyclictest17378-21ssh11:54:441
208812250,1sleep227-21ksoftirqd/210:41:122
208812250,1sleep227-21ksoftirqd/210:41:122
3147499244,4cyclictest131rcu_preempt10:26:072
3147499244,4cyclictest131rcu_preempt10:26:072
3147499243,7cyclictest27-21ksoftirqd/208:49:582
3147499243,7cyclictest27-21ksoftirqd/208:49:582
31474992412,10cyclictest27991-21ssh10:49:532
31474992412,10cyclictest27991-21ssh10:49:532
3147499241,20cyclictest8474-21grep09:06:042
3147499241,20cyclictest8474-21grep09:06:042
3147399247,3cyclictest131rcu_preempt10:46:011
3147399247,3cyclictest131rcu_preempt10:46:011
3147399243,18cyclictest9754-21cat11:46:041
3147399243,18cyclictest9754-21cat11:46:041
3147399243,18cyclictest23467-21switchtime12:36:231
3147399243,18cyclictest23467-21switchtime12:36:231
3147399243,18cyclictest23467-21switchtime12:36:231
3147499237,4cyclictest305222ssh12:10:272
3147499237,4cyclictest305222ssh12:10:272
3147499231,20cyclictest22347-21grep12:00:582
3147499231,20cyclictest22347-21grep12:00:582
31474992311,10cyclictest19615-21fschecks_count10:01:112
31473992314,7cyclictest5679-21ntp_states11:01:181
31473992314,7cyclictest5679-21ntp_states11:01:181
204452230,2sleep30-21swapper/312:33:383
204452230,2sleep30-21swapper/312:33:383
121392230,2sleep30-21swapper/307:46:233
121392230,2sleep30-21swapper/307:46:233
3147499224,3cyclictest131rcu_preempt08:52:272
3147499224,3cyclictest131rcu_preempt08:52:272
3147499222,18cyclictest29541-21latency_hist08:36:012
3147499222,18cyclictest29541-21latency_hist08:36:012
3147499222,17cyclictest26242-21fschecks_time08:26:132
3147499222,17cyclictest26242-21fschecks_time08:26:132
3147499222,17cyclictest21152-21latency_hist11:21:052
3147499222,17cyclictest21152-21latency_hist11:21:052
3147499221,7cyclictest27324-21fschecks_count09:31:122
3147499221,7cyclictest27324-21fschecks_count09:31:122
31474992214,6cyclictest2637-21ssh10:57:272
31474992214,6cyclictest2637-21ssh10:57:272
31474992214,5cyclictest10136-21fschecks_count11:46:142
31474992214,5cyclictest10136-21fschecks_count11:46:142
3147499221,19cyclictest6448-21latency_hist09:00:582
3147499221,19cyclictest6448-21latency_hist09:00:582
3147499221,18cyclictest13735-21ls07:51:212
3147499221,18cyclictest13735-21ls07:51:212
3147499221,17cyclictest14864-21fschecks_count09:16:122
3147499221,17cyclictest14864-21fschecks_count09:16:122
31474992210,10cyclictest8657-21ntpq10:26:192
3147399222,18cyclictest3428-21processes09:41:191
3147399222,18cyclictest3428-21processes09:41:191
3147399222,18cyclictest13454-21timerandwakeup12:26:251
3147399221,4cyclictest0-21swapper/108:56:161
3147399221,4cyclictest0-21swapper/108:56:161
303382221,16sleep30-21swapper/307:11:123
303382221,16sleep30-21swapper/307:11:123
119982220,3sleep30-21swapper/311:08:503
44512210,4sleep10-21swapper/111:39:311
44512210,4sleep10-21swapper/111:39:311
34092210,3sleep30-21swapper/307:26:063
3147499219,10cyclictest6789-21ssh12:20:292
3147499219,10cyclictest6789-21ssh12:20:292
3147499216,2cyclictest131rcu_preempt07:56:142
3147499214,6cyclictest27-21ksoftirqd/209:12:532
3147499212,17cyclictest732-21runrttasks11:33:502
3147499212,17cyclictest732-21runrttasks11:33:502
3147499212,17cyclictest1782-21fschecks_time07:21:122
3147499212,17cyclictest1782-21fschecks_time07:21:122
3147499212,15cyclictest10173-21diskmemload12:11:232
3147499212,15cyclictest10173-21diskmemload12:11:232
31474992114,6cyclictest24490-21ssh09:26:442
31474992114,6cyclictest24490-21ssh09:26:442
3147499211,18cyclictest6496-21latency_hist09:46:012
3147499211,18cyclictest6496-21latency_hist09:46:012
3147499211,18cyclictest23063-21irqstats12:01:152
3147499211,18cyclictest19509-21cat08:06:212
3147499211,18cyclictest19509-21cat08:06:212
3147499211,18cyclictest11899-21timerandwakeup07:46:222
3147499211,18cyclictest11899-21timerandwakeup07:46:222
3147499211,18cyclictest10303-21latency_hist09:11:032
3147499211,18cyclictest10303-21latency_hist09:11:032
3147499211,17cyclictest9160-21latency_hist11:06:062
3147499211,17cyclictest9160-21latency_hist11:06:062
3147499211,17cyclictest28184-21ssh10:11:112
3147499211,17cyclictest28184-21ssh10:11:112
3147499211,17cyclictest28184-21ssh10:11:112
3147499211,15cyclictest11145-21grep09:51:122
3147499211,15cyclictest11145-21grep09:51:122
3147399213,16cyclictest732-21runrttasks11:21:121
3147399212,17cyclictest9918-21switchtime07:41:201
3147399212,17cyclictest9918-21switchtime07:41:201
3147399211,14cyclictest11146-21cut09:51:121
3147399211,14cyclictest11146-21cut09:51:121
8062200,4sleep30-21swapper/308:45:593
73852200,3sleep10-21swapper/107:36:131
73852200,3sleep10-21swapper/107:36:131
54942200,3chrt0-21swapper/311:01:153
54942200,3chrt0-21swapper/311:01:153
31475992016,3cyclictest321rcuc/309:40:173
31475992016,3cyclictest321rcuc/309:40:173
3147599201,15cyclictest0-21swapper/307:21:103
3147499202,17cyclictest9535-21fschecks_time11:06:132
3147499201,17cyclictest561-21switchtime07:16:222
3147499201,17cyclictest561-21switchtime07:16:222
3147499201,17cyclictest29919-21fschecks_count08:36:132
3147499201,17cyclictest29919-21fschecks_count08:36:132
3147499201,17cyclictest2772-21sed11:36:282
3147499201,17cyclictest2772-21sed11:36:282
3147499201,17cyclictest16247-21latency_hist10:36:012
3147499201,17cyclictest16247-21latency_hist10:36:012
3147399204,14cyclictest709-21ssh10:56:101
3147399204,14cyclictest709-21ssh10:56:101
3147399204,14cyclictest26988-21/usr/sbin/munin12:06:141
3147399204,14cyclictest26988-21/usr/sbin/munin12:06:141
3147399203,15cyclictest732-21runrttasks08:04:591
3147399203,15cyclictest6393-21sed07:31:221
3147399203,15cyclictest23725-21sort10:06:111
3147399203,15cyclictest23725-21sort10:06:111
3147399203,15cyclictest20194-21ps10:01:191
3147399202,16cyclictest26857-21switchtime08:26:221
3147399202,16cyclictest26857-21switchtime08:26:221
31473992012,6cyclictest30005-21fschecks_time08:36:131
31473992012,6cyclictest30005-21fschecks_time08:36:131
253012200,3sleep30-21swapper/312:03:403
214612200,5sleep30-21swapper/311:21:123
3147599192,13cyclictest0-21swapper/310:31:133
3147599192,13cyclictest0-21swapper/310:31:133
31475991913,4cyclictest0-21swapper/311:55:173
31475991913,4cyclictest0-21swapper/311:48:143
31475991913,4cyclictest0-21swapper/311:48:143
3147599191,13cyclictest0-21swapper/312:21:123
3147599191,13cyclictest0-21swapper/312:21:123
3147599191,13cyclictest0-21swapper/308:21:013
3147599191,13cyclictest0-21swapper/308:21:013
3147599191,12cyclictest0-21swapper/309:41:103
3147599191,12cyclictest0-21swapper/309:41:103
3147599191,11cyclictest0-21swapper/310:36:133
3147599191,11cyclictest0-21swapper/310:36:133
3147499192,15cyclictest23936-21wc08:21:012
3147499192,15cyclictest23936-21wc08:21:012
3147499191,3cyclictest131rcu_preempt11:41:112
3147499191,3cyclictest131rcu_preempt11:41:112
3147499191,3cyclictest0-21swapper/211:26:402
3147499191,3cyclictest0-21swapper/211:26:402
3147499191,3cyclictest0-21swapper/211:26:402
31474991911,6cyclictest30901-21df09:36:112
31474991911,6cyclictest30901-21df09:36:112
3147499191,16cyclictest13944-21grep11:11:132
3147499191,16cyclictest13944-21grep11:11:132
3147499191,12cyclictest16904-21ls08:01:132
3147399197,10cyclictest7959-21unixbench_multi09:46:251
3147399197,10cyclictest7959-21unixbench_multi09:46:251
3147399193,14cyclictest28795-21sh10:51:051
3147399193,14cyclictest28795-21sh10:51:051
3147399193,14cyclictest19516-21latency09:21:151
3147399193,14cyclictest15199-21cpuspeed09:56:101
3147399193,14cyclictest15199-21cpuspeed09:56:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional