You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-03 - 07:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Apr 03, 2026 00:44:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
551822520,33sleep2371rcuc/218:59:242
551822520,33sleep2371rcuc/218:59:242
589229910,62sleep05931-21awk18:59:400
589229910,62sleep05931-21awk18:59:400
6681999425,29cyclictest39-21ksoftirqd/221:29:012
6681999425,29cyclictest39-21ksoftirqd/221:29:012
6675999474,14cyclictest3399-21kworker/u19:2-nfsiod23:33:571
6675999474,14cyclictest3399-21kworker/u19:2-nfsiod23:33:571
6681999369,8cyclictest181rcu_preempt23:39:382
6681999369,8cyclictest181rcu_preempt23:39:382
6681999360,9cyclictest181rcu_preempt19:42:032
6681999277,10cyclictest6655-21cyclictest22:39:282
6675999264,8cyclictest181rcu_preempt19:19:321
6681999017,42cyclictest39-21ksoftirqd/200:24:212
6681998956,7cyclictest181rcu_preempt21:08:152
6675998963,8cyclictest181rcu_preempt22:38:501
6675998963,8cyclictest181rcu_preempt22:38:501
6675998813,45cyclictest31-21ksoftirqd/122:06:571
6675998813,45cyclictest31-21ksoftirqd/122:06:571
6681998737,29cyclictest58-21kcompactd023:12:392
6681998737,29cyclictest58-21kcompactd023:12:392
6675998664,8cyclictest181rcu_preempt23:12:531
6675998664,8cyclictest181rcu_preempt23:12:531
6675998622,26cyclictest0-21swapper/121:20:001
6663998664,16cyclictest31187-21ssh00:13:570
6681998561,8cyclictest181rcu_preempt23:04:502
6681998561,8cyclictest181rcu_preempt23:04:502
6681998548,26cyclictest3399-21kworker/u19:2+nfsiod00:29:182
6681998514,42cyclictest39-21ksoftirqd/221:29:162
6675998562,8cyclictest181rcu_preempt23:40:461
6675998562,8cyclictest181rcu_preempt23:40:461
6675998561,17cyclictest6655-21cyclictest19:34:341
6675998561,17cyclictest6655-21cyclictest19:34:341
6675998548,9cyclictest181rcu_preempt21:41:161
6675998548,12cyclictest181rcu_preempt20:54:321
577628510,47sleep15796-21/usr/sbin/munin18:59:371
577628510,47sleep15796-21/usr/sbin/munin18:59:371
6681998459,12cyclictest181rcu_preempt23:00:462
6681998448,10cyclictest181rcu_preempt20:41:042
6681998448,10cyclictest181rcu_preempt20:41:042
6675998468,10cyclictest21889-21proc_pri22:09:311
6675998461,15cyclictest8671-21idleruntime-cro21:48:571
6675998461,15cyclictest8671-21idleruntime-cro21:48:571
6663998456,20cyclictest17134-21idleruntime-cro21:08:570
6681998361,8cyclictest181rcu_preempt20:59:332
6681998354,11cyclictest181rcu_preempt19:39:022
6681998346,21cyclictest0-21swapper/219:44:362
6681998343,17cyclictest6655-21cyclictest23:53:432
6675998341,24cyclictest20194-21unin-run21:13:591
6675998336,7cyclictest181rcu_preempt20:52:541
6663998321,29cyclictest3659-21sh23:27:260
6663998320,27cyclictest22777-21ssh22:10:520
6681998252,14cyclictest181rcu_preempt20:33:582
6681998245,17cyclictest0-21swapper/223:36:502
6675998259,15cyclictest6655-21cyclictest20:34:251
6675998250,8cyclictest181rcu_preempt23:54:021
6675998250,7cyclictest181rcu_preempt22:32:161
6675998236,22cyclictest6655-21cyclictest22:45:571
6675998236,22cyclictest6655-21cyclictest22:45:571
6675998230,9cyclictest0-21swapper/123:09:031
6675998230,9cyclictest0-21swapper/123:09:031
6663998266,10cyclictest27483-21http23:14:030
6663998264,12cyclictest10331-21latency_hist23:38:590
6663998262,13cyclictest22420-21latency_hist23:59:000
6681998161,14cyclictest11197-21fschecks_time20:54:182
6681998147,8cyclictest181rcu_preempt00:12:422
668199813,36cyclictest39-21ksoftirqd/222:30:502
6681998129,16cyclictest181rcu_preempt21:18:412
6681998126,16cyclictest181rcu_preempt23:48:582
6675998161,7cyclictest181rcu_preempt00:30:381
6675998158,7cyclictest181rcu_preempt21:33:131
6675998158,15cyclictest1655-21cstates23:24:131
6675998150,8cyclictest181rcu_preempt22:02:251
6675998140,12cyclictest181rcu_preempt00:03:301
6681998046,9cyclictest181rcu_preempt20:47:482
6681998046,9cyclictest181rcu_preempt20:47:482
6681998046,8cyclictest181rcu_preempt20:06:492
668199802,43cyclictest39-21ksoftirqd/220:29:002
668199802,43cyclictest39-21ksoftirqd/220:29:002
6675998049,8cyclictest181rcu_preempt21:26:571
6675998049,8cyclictest181rcu_preempt21:26:571
667599803,54cyclictest28007-21apt-get23:14:201
6675998023,9cyclictest181rcu_preempt22:17:451
6663998015,27cyclictest0-21swapper/022:54:070
6681997961,12cyclictest31786-21fschecks_count00:14:182
6681997955,13cyclictest0-21swapper/223:59:002
6681997948,13cyclictest181rcu_preempt21:53:142
6681997948,13cyclictest181rcu_preempt21:53:142
6681997944,8cyclictest181rcu_preempt22:20:452
6675997957,7cyclictest181rcu_preempt23:34:341
6675997956,8cyclictest181rcu_preempt22:42:341
6675997956,14cyclictest12232-21acpi21:54:071
6675997956,14cyclictest12232-21acpi21:54:071
6675997947,21cyclictest9189-21latency_hist20:49:001
6675997947,21cyclictest9189-21latency_hist20:49:001
6675997943,15cyclictest181rcu_preempt23:45:151
6675997941,12cyclictest181rcu_preempt23:51:391
6675997938,18cyclictest0-21swapper/119:14:021
6663997962,10cyclictest23095-21ssh23:59:260
668199783,47cyclictest12675-21grep19:19:192
6681997816,38cyclictest39-21ksoftirqd/219:38:362
6675997855,15cyclictest19898-21kworker/u17:0-xprtiod22:24:281
6675997855,15cyclictest19898-21kworker/u17:0-xprtiod22:24:281
6675997841,10cyclictest9455-21kworker/u17:1-xprtiod22:53:131
6675997840,11cyclictest181rcu_preempt00:13:181
6675997838,10cyclictest181rcu_preempt19:25:161
6675997813,37cyclictest31-21ksoftirqd/119:59:221
6675997813,37cyclictest31-21ksoftirqd/119:59:221
6663997825,23cyclictest2563-21cron20:28:570
6663997825,23cyclictest2563-21cron20:28:570
6681997757,10cyclictest0-21swapper/220:49:182
6681997740,8cyclictest181rcu_preempt21:09:302
6675997734,13cyclictest181rcu_preempt19:06:451
6675997734,13cyclictest181rcu_preempt19:06:451
6675997730,12cyclictest181rcu_preempt19:58:421
6675997726,19cyclictest0-21swapper/100:14:301
6675997718,32cyclictest31-21ksoftirqd/120:24:211
6675997718,32cyclictest31-21ksoftirqd/120:24:211
6663997724,43cyclictest29642-21/usr/sbin/munin21:29:180
6663997723,22cyclictest13496-21/usr/sbin/munin23:44:130
6663997721,22cyclictest9985-21/usr/sbin/munin20:49:300
6663997720,25cyclictest352-21runrttasks22:19:140
6663997719,29cyclictest26885-21taskset20:03:150
6663997719,29cyclictest26885-21taskset20:03:150
6681997656,9cyclictest0-21swapper/219:15:192
6681997656,12cyclictest6655-21cyclictest19:59:352
6681997656,12cyclictest6655-21cyclictest19:59:352
6681997646,7cyclictest181rcu_preempt22:54:042
6681997645,8cyclictest181rcu_preempt22:38:542
6681997645,8cyclictest181rcu_preempt22:38:542
6681997644,10cyclictest181rcu_preempt22:44:042
6681997644,10cyclictest181rcu_preempt22:44:042
6681997637,10cyclictest181rcu_preempt22:07:142
6681997637,10cyclictest181rcu_preempt22:07:142
6681997634,9cyclictest181rcu_preempt23:30:172
6681997634,9cyclictest181rcu_preempt23:30:172
6681997634,16cyclictest181rcu_preempt23:25:212
6675997648,7cyclictest181rcu_preempt23:00:041
6675997647,15cyclictest181rcu_preempt22:22:361
6675997645,7cyclictest181rcu_preempt21:35:091
6675997645,7cyclictest181rcu_preempt21:35:091
6675997632,11cyclictest181rcu_preempt20:14:231
667599762,59cyclictest19676-21snmpd00:24:221
6675997625,11cyclictest0-21swapper/100:06:281
6675997625,11cyclictest0-21swapper/100:06:281
6675997612,33cyclictest31-21ksoftirqd/120:12:191
6663997655,15cyclictest25118-21threads22:14:350
6663997655,15cyclictest15658-21latency_hist19:29:010
6663997646,21cyclictest5685-21sh21:43:580
6663997620,28cyclictest4384-21ssh00:22:580
6663997618,29cyclictest2084-21ssh21:37:220
6663997618,29cyclictest2084-21ssh21:37:220
6663997614,29cyclictest9301-21ssh22:43:370
6687997543,23cyclictest7642-21chrt22:39:343
668199757,30cyclictest39-21ksoftirqd/222:09:322
6681997547,10cyclictest181rcu_preempt00:19:432
6681997545,10cyclictest181rcu_preempt00:00:512
668199752,53cyclictest28078-21ssh23:14:202
6681997523,24cyclictest39-21ksoftirqd/221:42:392
6681997520,28cyclictest39-21ksoftirqd/220:34:342
6681997510,27cyclictest39-21ksoftirqd/219:09:172
6675997555,14cyclictest14148-21latency_hist21:04:011
6675997552,15cyclictest16339-21ssh22:54:251
6675997536,13cyclictest181rcu_preempt20:06:531
6675997535,7cyclictest0-21swapper/121:49:271
6675997535,7cyclictest0-21swapper/121:49:271
6675997517,21cyclictest31-21ksoftirqd/121:14:221
6663997548,20cyclictest28537-21kworker/u17:2+nfsiod23:20:050
6663997548,20cyclictest28537-21kworker/u17:2+nfsiod23:20:050
6663997538,27cyclictest24747-21apt-get23:09:130
6663997526,20cyclictest19676-21snmpd19:44:320
6663997522,24cyclictest27238-21sh00:06:170
6663997522,24cyclictest27238-21sh00:06:170
6663997522,23cyclictest18910-21ssh23:53:120
6663997521,24cyclictest13557-21taskset19:21:020
6663997520,28cyclictest7454-21sh21:45:360
6663997520,28cyclictest7454-21sh21:45:360
6663997520,28cyclictest19236-21rm21:11:290
6663997520,26cyclictest10719-21ssh21:51:220
6663997520,26cyclictest10719-21ssh21:51:220
6663997519,29cyclictest20060-21rm22:06:380
6663997519,29cyclictest20060-21rm22:06:380
6663997519,27cyclictest11775-21sh22:47:110
6663997519,27cyclictest11775-21sh22:47:110
6663997516,30cyclictest7244-21sh00:26:550
6681997454,11cyclictest0-21swapper/222:54:012
6681997445,9cyclictest181rcu_preempt20:10:222
6681997438,8cyclictest181rcu_preempt23:22:462
6681997438,8cyclictest181rcu_preempt23:22:462
668199742,38cyclictest39-21ksoftirqd/221:36:232
668199742,38cyclictest39-21ksoftirqd/221:36:232
6681997418,20cyclictest39-21ksoftirqd/219:09:002
6681997418,20cyclictest39-21ksoftirqd/219:09:002
6675997444,7cyclictest181rcu_preempt23:22:291
6675997444,7cyclictest181rcu_preempt23:22:291
6675997440,10cyclictest15302-21ssh21:04:581
6675997422,22cyclictest0-21swapper/120:21:551
6675997414,38cyclictest31-21ksoftirqd/120:39:311
6675997414,38cyclictest31-21ksoftirqd/120:39:311
6663997455,13cyclictest24489-21ssh21:19:360
6663997421,25cyclictest5271-21rm22:35:390
6663997421,25cyclictest5271-21rm22:35:390
6663997421,21cyclictest9917-21ssh00:31:030
6663997419,28cyclictest13113-21ssh23:43:430
6663997419,28cyclictest13113-21ssh23:43:430
6681997348,10cyclictest181rcu_preempt00:07:172
6681997348,10cyclictest181rcu_preempt00:07:172
6681997327,23cyclictest39-21ksoftirqd/221:19:352
6681997326,12cyclictest181rcu_preempt21:44:272
6681997326,12cyclictest181rcu_preempt21:44:272
6675997346,10cyclictest181rcu_preempt19:39:231
6675997334,19cyclictest0-21swapper/120:32:211
6675997333,14cyclictest181rcu_preempt19:29:171
666399736,28cyclictest0-21swapper/020:59:180
6663997326,19cyclictest30713-21sh23:18:580
6663997321,24cyclictest13986-21rm21:56:210
6663997321,24cyclictest13986-21rm21:56:210
6663997320,43cyclictest19676-21snmpd19:09:250
6663997320,27cyclictest32655-21sh00:14:380
6663997319,25cyclictest23087-21ssh23:05:130
6663997319,25cyclictest23087-21ssh23:05:130
6663997318,28cyclictest14779-21ssh22:52:130
6663997315,23cyclictest0-21swapper/020:29:110
6663997313,22cyclictest0-21swapper/022:24:150
6663997313,22cyclictest0-21swapper/022:24:150
6681997241,24cyclictest6885-21kworker/u19:1+nfsiod21:58:122
6681997241,24cyclictest6885-21kworker/u19:1+nfsiod21:58:122
6681997222,21cyclictest39-21ksoftirqd/220:19:012
6675997245,14cyclictest181rcu_preempt00:22:351
666399729,34cyclictest23955-21taskset19:54:020
666399728,24cyclictest0-21swapper/023:29:200
666399728,24cyclictest0-21swapper/023:29:200
6663997222,19cyclictest20479-21cron19:43:570
6663997220,25cyclictest20178-21ssh23:00:300
6663997219,24cyclictest27744-21sh21:25:070
6663997219,24cyclictest27744-21sh21:25:070
6663997219,24cyclictest20444-21ssh21:14:070
6663997218,22cyclictest703-21seq20:20:430
6663997218,19cyclictest8715-21taskset20:44:550
6663997218,19cyclictest8715-21taskset20:44:550
6663997217,24cyclictest31631-21taskset20:16:480
6663997214,24cyclictest5837-21idleruntime-cro20:38:580
6663997214,22cyclictest0-21swapper/020:54:240
668199714,30cyclictest39-21ksoftirqd/219:49:262
6681997138,7cyclictest181rcu_preempt20:19:322
6681997137,11cyclictest181rcu_preempt19:24:282
668199713,38cyclictest39-21ksoftirqd/221:59:142
6681997111,33cyclictest39-21ksoftirqd/222:18:122
6675997157,7cyclictest0-21swapper/119:49:191
6675997125,7cyclictest0-21swapper/119:44:341
6663997149,16cyclictest298-21in:imuxsock22:33:570
6663997117,25cyclictest18640-21taskset19:35:570
6663997117,25cyclictest18640-21taskset19:35:570
6663997116,19cyclictest7179-21seq20:40:520
6663997116,19cyclictest7179-21seq20:40:520
6663997112,28cyclictest0-21swapper/019:06:430
6663997112,28cyclictest0-21swapper/019:06:430
6681997031,9cyclictest181rcu_preempt19:32:262
6681997015,19cyclictest39-21ksoftirqd/219:54:242
6675997021,12cyclictest181rcu_preempt19:15:251
6663997019,23cyclictest15260-21runrttasks21:59:110
6663997017,21cyclictest0-21swapper/019:30:000
6663997015,24cyclictest28327-21taskset20:06:060
6681996849,13cyclictest31217-21sh22:24:372
6681996849,13cyclictest31217-21sh22:24:372
6663996826,30cyclictest23998-21apt-get19:54:080
279332680,6sleep30-21swapper/321:25:403
279332680,6sleep30-21swapper/321:25:403
6663996719,24cyclictest11979-21seq19:16:270
6663996647,12cyclictest30370-21latency_hist20:14:010
51482620,6sleep30-21swapper/321:42:343
568325411,26sleep30-21swapper/318:59:303
568325411,26sleep30-21swapper/318:59:303
668799533,36cyclictest23437-21taskset21:19:073
668799513,37cyclictest32364-21taskset22:27:303
668799513,37cyclictest32364-21taskset22:27:303
668799503,37cyclictest28630-21chrt23:14:443
668799503,37cyclictest19264-21taskset23:53:593
668799503,35cyclictest29825-21taskset21:29:213
668799498,31cyclictest10866-21chrt19:14:233
668799493,32cyclictest17392-21taskset21:09:023
668799492,36cyclictest9889-21taskset19:09:373
668799483,35cyclictest9267-21chrt21:49:193
668799483,35cyclictest9267-21chrt21:49:193
668799483,35cyclictest6648-21chrt00:25:163
668799483,35cyclictest25304-21taskset22:14:373
668799483,34cyclictest31189-21chrt00:13:573
668799483,34cyclictest19091-21taskset19:39:023
668799483,34cyclictest19091-21taskset19:39:023
668799483,34cyclictest15878-21chrt22:54:143
668799483,33cyclictest2568-21taskset23:24:333
668799482,35cyclictest1337-21chrt20:24:143
668799482,35cyclictest1337-21chrt20:24:143
668799473,34cyclictest7560-21taskset23:34:093
668799473,34cyclictest7226-21chrt23:33:573
668799473,34cyclictest7226-21chrt23:33:573
668799473,34cyclictest3172-21taskset20:29:203
668799473,34cyclictest14301-21chrt22:50:533
668799473,31cyclictest6935-21chrt19:04:143
668799473,31cyclictest6935-21chrt19:04:143
668799472,35cyclictest4384-21chrt22:34:273
668799472,35cyclictest4384-21chrt22:34:273
668799472,35cyclictest19765-21chrt22:05:493
668799472,35cyclictest19765-21chrt22:05:493
668799472,32cyclictest10239-21taskset22:44:213
668799472,32cyclictest10239-21taskset22:44:213
668799463,33cyclictest6154-21chrt21:44:163
668799463,33cyclictest6154-21chrt21:44:163
668799463,33cyclictest4302-21taskset00:22:443
668799463,33cyclictest29907-21taskset22:23:573
668799463,33cyclictest25019-21chrt19:54:583
668799463,33cyclictest13956-21taskset21:56:163
668799463,33cyclictest13956-21taskset21:56:163
668799463,32cyclictest25373-21taskset00:04:003
668799463,32cyclictest16951-21taskset19:30:393
668799463,32cyclictest16107-21taskset23:48:443
668799463,32cyclictest12814-21chrt20:59:213
668799463,31cyclictest30413-21taskset20:14:013
668799462,34cyclictest22127-21taskset21:16:073
668799453,32cyclictest14669-21chrt21:04:403
668799453,31cyclictest26053-21taskset00:04:253
668799453,31cyclictest26053-21taskset00:04:253
668799453,31cyclictest19243-21chrt19:39:143
668799453,31cyclictest14050-21chrt19:24:073
668799452,33cyclictest8996-21chrt20:48:363
668799452,33cyclictest8996-21chrt20:48:363
668799452,33cyclictest26477-21chrt23:11:203
668799452,33cyclictest26477-21chrt23:11:203
668799452,33cyclictest21577-21chrt22:09:223
668799452,32cyclictest11159-21taskset23:39:283
668799452,32cyclictest11159-21taskset23:39:283
668799443,31cyclictest5144-21chrt20:34:313
668799443,31cyclictest32759-21taskset20:19:323
668799443,31cyclictest22355-21chrt23:04:273
668799443,31cyclictest22355-21chrt23:04:273
668799443,31cyclictest20948-21chrt23:55:253
668799443,31cyclictest20815-21chrt23:02:163
668799443,31cyclictest1349-21chrt23:24:003
668799443,31cyclictest1349-21chrt23:24:003
668799443,30cyclictest22536-21chrt19:49:193
668799442,33cyclictest32610-21chrt00:14:343
668799442,32cyclictest547-21chrt21:34:283
668799442,32cyclictest547-21chrt21:34:283
668799434,30cyclictest27782-21chrt20:04:303
668799433,30cyclictest16041-21chrt21:59:323
668799433,30cyclictest10577-21chrt00:32:543
668799433,29cyclictest26145-21taskset19:59:273
668799433,29cyclictest26145-21taskset19:59:273
668799433,29cyclictest12476-21chrt20:59:013
668799433,27cyclictest20766-21chrt19:44:123
668799432,31cyclictest30823-21taskset20:14:223
668799432,31cyclictest13328-21chrt19:19:333
668799432,30cyclictest10339-21taskset20:50:103
668799432,29cyclictest6241-21taskset20:39:173
668799432,29cyclictest6241-21taskset20:39:173
668799423,29cyclictest975-21chrt22:29:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional