You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-27 - 15:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Wed Aug 27, 2025 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1748996518,7cyclictest131rcu_preempt10:53:141
1748996518,7cyclictest131rcu_preempt10:53:141
1747995327,19cyclictest38650irq/55-eth008:03:130
1747995327,19cyclictest38650irq/55-eth008:03:130
174899512,37cyclictest26574-21ssh09:43:131
174899512,37cyclictest26574-21ssh09:43:131
1747995011,28cyclictest131rcu_preempt09:43:130
1747995011,28cyclictest131rcu_preempt09:43:130
174799488,18cyclictest12-21ksoftirqd/007:33:150
174799488,18cyclictest12-21ksoftirqd/007:33:150
1747994811,30cyclictest24052-21ssh11:08:130
1747994811,30cyclictest24052-21ssh11:08:130
174799464,6cyclictest131rcu_preempt11:43:160
174999439,12cyclictest9002-21find09:18:282
174999439,12cyclictest9002-21find09:18:282
174799434,26cyclictest38650irq/55-eth010:03:130
174799434,26cyclictest38650irq/55-eth010:03:130
174799433,6cyclictest131rcu_preempt08:53:140
174799430,32cyclictest10029-21ssh12:08:140
174799430,32cyclictest10029-21ssh12:08:140
174999421,34cyclictest31027-21ssh10:33:122
174999421,34cyclictest31027-21ssh10:33:122
174899426,5cyclictest131rcu_preempt07:33:151
174899426,5cyclictest131rcu_preempt07:33:151
1748994219,8cyclictest4466-21find07:23:281
1748994219,8cyclictest4466-21find07:23:281
1748994218,16cyclictest21-21ksoftirqd/108:23:151
1748994218,16cyclictest21-21ksoftirqd/108:23:151
175099388,22cyclictest0-21swapper/311:13:143
174899381,6cyclictest131rcu_preempt08:13:131
174899381,6cyclictest131rcu_preempt08:13:131
174899370,28cyclictest19399-21ssh12:18:151
174899370,28cyclictest19399-21ssh12:18:151
174799362,24cyclictest2724-21diskmemload11:23:120
174799362,24cyclictest2724-21diskmemload11:23:120
174999351,4cyclictest0-21swapper/211:28:302
174999351,4cyclictest0-21swapper/211:28:302
174799354,19cyclictest38650irq/55-eth011:48:130
1747993521,9cyclictest38650irq/55-eth011:38:140
1747993521,9cyclictest38650irq/55-eth011:38:140
174999346,10cyclictest15786-21find12:13:272
174999346,10cyclictest15786-21find12:13:272
174999345,12cyclictest8148-21ssh10:02:372
174999345,12cyclictest8148-21ssh10:02:372
1749993421,9cyclictest19090-21cut09:33:092
174999341,28cyclictest1044-21sh12:33:142
174899341,20cyclictest2728-21ssh11:23:121
174899341,20cyclictest2728-21ssh11:23:121
174799341,24cyclictest0-21swapper/009:33:170
174799341,24cyclictest0-21swapper/009:33:170
174999335,12cyclictest12571-21ssh11:34:032
174999335,12cyclictest12571-21ssh11:34:032
174999335,12cyclictest12571-21ssh11:34:032
174999334,12cyclictest27580-21ssh11:52:102
1748993315,11cyclictest11354-21sendmail-msp09:23:171
1748993315,11cyclictest11354-21sendmail-msp09:23:171
1747993318,10cyclictest38650irq/55-eth011:53:140
1747993318,10cyclictest38650irq/55-eth011:53:140
174999324,9cyclictest25195-21find12:23:252
174999324,9cyclictest25195-21find12:23:252
174999324,13cyclictest3979-21ssh09:56:222
174999324,13cyclictest3979-21ssh09:56:222
174999324,12cyclictest359-21ssh09:51:412
174999324,12cyclictest359-21ssh09:51:412
174999324,10cyclictest22760-21ssh12:21:282
174999324,10cyclictest22760-21ssh12:21:282
1749993220,8cyclictest13513-21find10:08:292
174899322,8cyclictest21-21ksoftirqd/112:03:161
174899322,8cyclictest21-21ksoftirqd/112:03:161
174799323,21cyclictest38650irq/55-eth012:18:150
174799323,21cyclictest38650irq/55-eth012:18:150
174999314,12cyclictest28391-21ssh09:44:432
174999314,12cyclictest28391-21ssh09:44:432
174999313,22cyclictest9718-21sh10:48:152
174999313,22cyclictest9718-21sh10:48:152
174999313,11cyclictest22688-21ssh11:05:512
1749993122,5cyclictest15550-21apt-get08:03:132
1749993122,5cyclictest15550-21apt-get08:03:132
1747993118,6cyclictest4176-21diskmemload10:08:290
174999309,18cyclictest16148-21find11:38:262
174999309,18cyclictest16148-21find11:38:262
174999304,9cyclictest8567-21ssh10:46:202
174999304,9cyclictest8567-21ssh10:46:202
174999304,10cyclictest26025-21ssh11:09:502
174999304,10cyclictest26025-21ssh11:09:502
174999303,11cyclictest8274-21ssh12:05:512
174999303,11cyclictest8274-21ssh12:05:512
174999303,11cyclictest15888-21ssh10:57:172
174999303,11cyclictest15888-21ssh10:57:172
174999303,11cyclictest12042-21sh10:07:542
174999303,11cyclictest12042-21sh10:07:542
174999301,24cyclictest26182-21date08:38:092
174999301,24cyclictest26182-21date08:38:092
174999301,24cyclictest26182-21date08:38:092
174899302,22cyclictest6592-21ssh11:28:171
174899302,22cyclictest6592-21ssh11:28:171
1747993018,8cyclictest38650irq/55-eth012:23:120
1747993018,8cyclictest38650irq/55-eth012:23:120
1747993018,8cyclictest38650irq/55-eth009:43:100
1747993015,7cyclictest11968-21find11:33:290
1747993015,7cyclictest11968-21find11:33:290
1747993015,7cyclictest11968-21find11:33:290
174799301,23cyclictest0-21swapper/012:38:140
174799301,23cyclictest0-21swapper/012:38:140
174999299,7cyclictest131rcu_preempt08:58:132
174999295,11cyclictest31449-21ssh11:55:582
174999295,11cyclictest31449-21ssh11:55:582
174999294,11cyclictest18616-21ssh10:15:502
174999294,11cyclictest18616-21ssh10:15:502
174999293,8cyclictest0-21swapper/208:23:282
174999293,8cyclictest0-21swapper/208:23:282
174999293,10cyclictest9734-21ssh12:42:392
174999293,10cyclictest9734-21ssh12:42:392
174999293,10cyclictest29500-21ssh10:30:082
174999293,10cyclictest29500-21ssh10:30:082
174999293,10cyclictest2437-21ssh11:59:022
174999293,10cyclictest18960-21ssh11:01:202
174999293,10cyclictest18960-21ssh11:01:202
1749992923,3cyclictest0-21swapper/211:13:142
1749992917,9cyclictest22546-21apt-get09:38:132
1749992917,9cyclictest22546-21apt-get09:38:132
174899298,14cyclictest21281-21kworker/u8:208:43:141
174899298,14cyclictest21281-21kworker/u8:208:43:141
174899295,3cyclictest131rcu_preempt09:18:281
174899295,3cyclictest131rcu_preempt09:18:281
174899292,5cyclictest21-21ksoftirqd/107:43:261
174899292,5cyclictest21-21ksoftirqd/107:43:261
174899292,22cyclictest10039-21ssh12:08:151
174899292,22cyclictest10039-21ssh12:08:151
1748992913,6cyclictest16399-21find09:28:281
1748992913,6cyclictest16399-21find09:28:281
174899291,22cyclictest15128-21sh11:38:131
174899291,22cyclictest15128-21sh11:38:131
1747992911,14cyclictest131rcu_preempt09:38:130
174999286,8cyclictest10984-21apt-get07:48:152
174999286,8cyclictest10984-21apt-get07:48:152
174999285,8cyclictest13967-21ssh12:12:242
174999285,8cyclictest13967-21ssh12:12:242
174999283,6cyclictest27-21ksoftirqd/208:53:152
174999283,11cyclictest21342-21ssh09:36:102
174999283,11cyclictest21342-21ssh09:36:102
174999282,21cyclictest1184-21sendmail-msp09:03:132
174999282,21cyclictest1184-21sendmail-msp09:03:132
174899289,5cyclictest131rcu_preempt09:53:271
174899289,5cyclictest131rcu_preempt09:53:271
174899282,21cyclictest5700-21ssh12:38:161
174899282,21cyclictest5700-21ssh12:38:161
174799283,16cyclictest38650irq/55-eth009:23:150
174799283,16cyclictest38650irq/55-eth009:23:150
174999278,7cyclictest5577-21bingrep07:28:202
174999278,7cyclictest5577-21bingrep07:28:202
174999277,5cyclictest0-21swapper/208:28:162
174999277,5cyclictest0-21swapper/208:28:162
174999275,19cyclictest4519-21rm09:13:152
174999275,19cyclictest4519-21rm09:13:152
174999275,10cyclictest22785-21ssh11:47:002
174999274,7cyclictest0-21swapper/212:28:242
174999272,11cyclictest2278-21ssh11:22:502
174999272,11cyclictest2278-21ssh11:22:502
174899274,20cyclictest31022-21ssh10:33:121
174899274,20cyclictest31022-21ssh10:33:121
174899272,4cyclictest131rcu_preempt12:28:151
1748992711,4cyclictest131rcu_preempt11:18:171
1748992711,4cyclictest131rcu_preempt11:18:171
1748992710,8cyclictest21-21ksoftirqd/108:23:011
174799271,20cyclictest14759-21ssh12:13:150
174799271,20cyclictest14759-21ssh12:13:150
174799271,20cyclictest0-21swapper/008:58:120
175099263,16cyclictest0-21swapper/309:13:153
175099263,16cyclictest0-21swapper/309:13:153
174999266,16cyclictest27-21ksoftirqd/210:18:152
174999262,21cyclictest2738-21ssh11:23:132
174999262,21cyclictest2738-21ssh11:23:132
1749992612,11cyclictest30124-21find08:48:262
1749992612,11cyclictest30124-21find08:48:262
1749992611,10cyclictest9509-21apt-get07:43:132
1749992611,10cyclictest9509-21apt-get07:43:132
1749992610,7cyclictest28650-21find08:43:262
1749992610,7cyclictest28650-21find08:43:262
174899268,10cyclictest21-21ksoftirqd/111:48:021
174899267,6cyclictest21-21ksoftirqd/112:02:261
174899262,20cyclictest1037-21ssh12:33:131
1748992610,8cyclictest21-21ksoftirqd/110:10:131
174799262,19cyclictest4521-21ssh09:13:150
174799262,19cyclictest4521-21ssh09:13:150
1747992619,4cyclictest38650irq/55-eth012:03:140
1747992619,4cyclictest38650irq/55-eth012:03:140
174799261,18cyclictest16536-21ssh10:58:150
174799261,18cyclictest16536-21ssh10:58:150
175099258,12cyclictest0-21swapper/308:38:093
175099258,12cyclictest0-21swapper/308:38:093
175099258,12cyclictest0-21swapper/308:38:093
175099254,14cyclictest0-21swapper/311:38:133
175099254,14cyclictest0-21swapper/311:38:133
174999258,4cyclictest0-21swapper/210:39:102
174999258,4cyclictest0-21swapper/210:39:102
174999257,6cyclictest0-21swapper/208:18:142
174999255,5cyclictest27-21ksoftirqd/207:33:252
174999255,5cyclictest27-21ksoftirqd/207:33:252
174999255,3cyclictest131rcu_preempt08:08:262
174999255,3cyclictest131rcu_preempt08:08:262
174999254,8cyclictest17777-21ssh09:30:512
174999253,16cyclictest0-21swapper/207:23:142
174999253,16cyclictest0-21swapper/207:23:142
174999253,10cyclictest26033-21latency_hist08:38:032
174999253,10cyclictest26033-21latency_hist08:38:032
174999251,18cyclictest0-21swapper/207:18:152
174999251,18cyclictest0-21swapper/207:18:152
174899259,8cyclictest21-21ksoftirqd/110:41:051
174899259,8cyclictest21-21ksoftirqd/110:41:051
174899253,5cyclictest21-21ksoftirqd/108:53:051
174899253,5cyclictest21-21ksoftirqd/108:53:051
174899253,3cyclictest131rcu_preempt12:23:261
174899253,3cyclictest131rcu_preempt12:23:261
174899253,16cyclictest28480-21rm11:53:141
174899253,16cyclictest28480-21rm11:53:141
174899252,5cyclictest21-21ksoftirqd/110:23:291
174899252,5cyclictest21-21ksoftirqd/110:23:291
174899250,4cyclictest6106-21find09:58:261
174899250,4cyclictest6106-21find09:58:261
174799258,5cyclictest131rcu_preempt12:28:130
174799254,14cyclictest17481-21avahi-daemon08:28:140
174799254,14cyclictest17481-21avahi-daemon08:28:140
1747992514,7cyclictest12-21ksoftirqd/009:58:260
1747992514,7cyclictest12-21ksoftirqd/009:58:260
174799251,19cyclictest20024-21latency_hist10:18:100
174799251,19cyclictest20024-21latency_hist10:18:100
175099245,14cyclictest0-21swapper/309:18:143
175099245,14cyclictest0-21swapper/309:18:143
174999243,6cyclictest27-21ksoftirqd/209:08:192
174999243,6cyclictest27-21ksoftirqd/209:08:192
174999243,4cyclictest27-21ksoftirqd/207:43:002
174999243,4cyclictest27-21ksoftirqd/207:43:002
174999242,11cyclictest11730-21ssh09:23:112
174999242,11cyclictest11730-21ssh09:23:112
1749992418,3cyclictest18556-21apt-get08:13:142
1749992418,3cyclictest18556-21apt-get08:13:142
174999241,20cyclictest23712-21sh10:23:162
174999241,20cyclictest23712-21sh10:23:162
174899247,5cyclictest21-21ksoftirqd/111:50:181
174899245,5cyclictest21-21ksoftirqd/110:03:281
174899245,5cyclictest21-21ksoftirqd/110:03:281
174899245,4cyclictest131rcu_preempt10:18:281
1748992414,4cyclictest21-21ksoftirqd/111:33:301
1748992414,4cyclictest21-21ksoftirqd/111:33:301
1748992414,4cyclictest21-21ksoftirqd/111:33:301
174899240,6cyclictest27117-21find08:38:271
174899240,6cyclictest27117-21find08:38:271
174899240,6cyclictest27117-21find08:38:271
174799245,3cyclictest131rcu_preempt08:18:260
1747992420,3cyclictest2642-21kworker/u8:209:09:360
1747992420,3cyclictest2642-21kworker/u8:209:09:360
1747992415,6cyclictest0-21swapper/008:48:130
1747992415,6cyclictest0-21swapper/008:48:130
174799241,16cyclictest5799-21ssh10:43:140
174799241,16cyclictest5799-21ssh10:43:140
175099235,13cyclictest0-21swapper/312:03:153
175099235,13cyclictest0-21swapper/312:03:153
174899239,8cyclictest21-21ksoftirqd/112:15:521
174899239,8cyclictest21-21ksoftirqd/112:15:521
174899238,8cyclictest21-21ksoftirqd/109:15:241
174899238,8cyclictest21-21ksoftirqd/109:15:241
174899236,3cyclictest131rcu_preempt08:38:091
174899233,3cyclictest131rcu_preempt09:48:161
174899233,3cyclictest131rcu_preempt09:48:161
174899232,6cyclictest21-21ksoftirqd/108:53:261
174899232,5cyclictest21-21ksoftirqd/110:13:271
174899232,5cyclictest21-21ksoftirqd/110:13:271
174899232,19cyclictest2351-21grep09:03:251
174899232,19cyclictest2351-21grep09:03:251
1748992317,4cyclictest21-21ksoftirqd/111:08:271
1748992317,4cyclictest21-21ksoftirqd/111:08:271
174899231,4cyclictest131rcu_preempt11:13:261
1748992313,7cyclictest19826-21sendmail-msp11:03:131
174799235,6cyclictest12-21ksoftirqd/012:33:260
1747992319,2cyclictest0-21swapper/011:58:150
1747992313,5cyclictest12-21ksoftirqd/011:18:170
1747992313,5cyclictest12-21ksoftirqd/011:18:170
1747992312,9cyclictest12-21ksoftirqd/010:33:130
1747992312,9cyclictest12-21ksoftirqd/010:33:130
174799231,14cyclictest0-21swapper/010:53:160
174799231,14cyclictest0-21swapper/010:53:160
1747992311,3cyclictest12-21ksoftirqd/011:28:190
1747992311,3cyclictest12-21ksoftirqd/011:28:190
174799231,11cyclictest8712-21proc_pri07:38:240
174799231,11cyclictest8712-21proc_pri07:38:240
174999228,10cyclictest12493-21apt-get07:53:142
174999222,4cyclictest27-21ksoftirqd/207:58:132
174999222,4cyclictest27-21ksoftirqd/207:58:132
174999222,4cyclictest27-21ksoftirqd/207:58:132
174899228,8cyclictest21-21ksoftirqd/110:32:011
174899228,8cyclictest21-21ksoftirqd/110:32:011
174899227,8cyclictest21-21ksoftirqd/107:28:131
174899227,8cyclictest21-21ksoftirqd/107:28:131
174899224,7cyclictest21-21ksoftirqd/111:01:551
174899224,7cyclictest21-21ksoftirqd/111:01:551
1748992211,9cyclictest21-21ksoftirqd/109:33:191
1748992211,9cyclictest21-21ksoftirqd/109:33:191
174899221,17cyclictest9719-21sh10:48:151
174899221,17cyclictest9719-21sh10:48:151
174899221,17cyclictest0-21swapper/108:58:251
174899221,13cyclictest21-21ksoftirqd/107:48:181
174899221,13cyclictest21-21ksoftirqd/107:48:181
1748992210,4cyclictest21-21ksoftirqd/109:40:281
1748992210,4cyclictest21-21ksoftirqd/109:40:281
1748992210,4cyclictest131rcu_preempt08:33:161
174799224,6cyclictest2465-21find09:53:270
174799224,6cyclictest2465-21find09:53:270
1747992213,4cyclictest12-21ksoftirqd/008:38:080
1747992213,4cyclictest12-21ksoftirqd/008:38:080
1747992212,9cyclictest12-21ksoftirqd/010:18:160
174799221,17cyclictest23711-21ssh10:23:160
174799221,17cyclictest23711-21ssh10:23:160
174799221,17cyclictest18538-21find08:13:130
174799221,17cyclictest18538-21find08:13:130
175099213,12cyclictest0-21swapper/311:28:173
175099213,12cyclictest0-21swapper/311:28:173
174899217,8cyclictest21-21ksoftirqd/108:28:141
174899217,8cyclictest21-21ksoftirqd/108:28:141
174899216,8cyclictest21-21ksoftirqd/108:13:061
174899216,8cyclictest21-21ksoftirqd/108:13:061
1748992113,6cyclictest131rcu_preempt10:43:161
1748992113,6cyclictest131rcu_preempt10:43:161
174899211,2cyclictest131rcu_preempt07:53:271
174799219,3cyclictest0-21swapper/010:41:110
174799219,3cyclictest0-21swapper/010:41:110
174799215,11cyclictest27373-21ssh10:28:120
174799215,11cyclictest27373-21ssh10:28:120
174799213,7cyclictest12-21ksoftirqd/009:28:250
174799213,7cyclictest12-21ksoftirqd/009:28:250
174799213,14cyclictest30050irq/49-vc409:15:190
174799213,14cyclictest30050irq/49-vc409:15:190
174799213,13cyclictest12-21ksoftirqd/011:13:130
1747992115,4cyclictest0-21swapper/008:23:270
1747992115,4cyclictest0-21swapper/008:23:270
1747992113,3cyclictest131rcu_preempt11:03:150
1747992110,8cyclictest4176-21diskmemload09:48:140
1747992110,8cyclictest4176-21diskmemload09:48:140
1747992110,3cyclictest12-21ksoftirqd/007:18:270
1747992110,3cyclictest12-21ksoftirqd/007:18:270
174799210,5cyclictest16825-21snmpd07:28:280
174799210,5cyclictest16825-21snmpd07:28:280
175099203,11cyclictest0-21swapper/312:33:143
175099202,12cyclictest0-21swapper/311:43:173
174899205,3cyclictest131rcu_preempt07:58:161
174899205,3cyclictest131rcu_preempt07:58:161
174899205,3cyclictest131rcu_preempt07:58:161
174899200,4cyclictest3860-21find09:08:271
174899200,4cyclictest3860-21find09:08:271
1747992014,4cyclictest38650irq/55-eth007:23:290
1747992014,4cyclictest38650irq/55-eth007:23:290
174799201,3cyclictest0-21swapper/008:08:130
174799201,3cyclictest0-21swapper/008:08:130
1747992011,7cyclictest0-21swapper/010:48:130
1747992011,7cyclictest0-21swapper/010:48:130
1747992011,7cyclictest0-21swapper/009:23:080
1747992011,7cyclictest0-21swapper/009:23:080
174799201,15cyclictest12644-21fschecks_count07:53:160
174799201,11cyclictest11916-21awk07:48:260
174799201,11cyclictest11916-21awk07:48:260
175099195,11cyclictest0-21swapper/310:43:133
175099195,11cyclictest0-21swapper/310:43:133
175099193,12cyclictest0-21swapper/310:38:173
175099193,12cyclictest0-21swapper/310:38:173
175099193,12cyclictest0-21swapper/308:33:143
175099193,12cyclictest0-21swapper/308:33:143
175099193,11cyclictest0-21swapper/312:38:153
175099193,11cyclictest0-21swapper/312:38:153
175099193,11cyclictest0-21swapper/310:03:143
175099193,11cyclictest0-21swapper/310:03:143
175099193,11cyclictest0-21swapper/309:53:143
175099193,11cyclictest0-21swapper/309:53:143
175099193,11cyclictest0-21swapper/308:28:143
175099193,11cyclictest0-21swapper/308:28:143
175099193,10cyclictest0-21swapper/310:23:183
175099193,10cyclictest0-21swapper/310:23:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional