You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 01:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri May 29, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9768999571,16cyclictest1-21systemd09:10:100
9768999468,17cyclictest12543-21latency_hist07:10:140
9768999364,18cyclictest9137-21kworker/u19:0-rpciod10:56:400
9768999215,43cyclictest15-21ksoftirqd/007:01:290
9768999067,15cyclictest21873-21latency_hist07:50:140
9776998824,25cyclictest19630-21seq11:57:282
9776998824,25cyclictest19630-21seq11:57:282
9768998860,9cyclictest181rcu_preempt12:20:490
9768998860,9cyclictest181rcu_preempt12:20:490
976899877,51cyclictest15-21ksoftirqd/008:21:590
9776998625,23cyclictest7883-21seq08:56:462
9776998616,30cyclictest12925-21fschecks_time07:10:342
976899862,38cyclictest15-21ksoftirqd/009:56:090
9776998565,14cyclictest29529-21latency_hist08:20:132
9776998533,42cyclictest0-21swapper/209:45:262
976899854,63cyclictest87-21kswapd007:40:230
976899854,63cyclictest87-21kswapd007:40:230
9776998429,27cyclictest2024-21seq12:21:202
9776998429,27cyclictest2024-21seq12:21:202
9776998426,21cyclictest16817-21seq11:52:582
9776998417,28cyclictest27685-21grep12:11:102
9776998417,27cyclictest0-21swapper/209:59:012
9768998461,17cyclictest9243-21idleruntime-cro10:50:100
966128413,42sleep0277-21dbus-daemon07:00:130
9776998321,26cyclictest352-21runrttasks09:07:282
9776998320,30cyclictest4676-21apt-get08:51:272
9776998318,26cyclictest1925-21runrttasks10:36:272
9774998366,12cyclictest30643-21latency_hist11:25:131
9774998366,12cyclictest30643-21latency_hist11:25:131
9774998362,9cyclictest0-21swapper/107:20:271
9774998362,9cyclictest0-21swapper/107:20:271
9776998224,23cyclictest31315-21seq08:26:042
9776998223,23cyclictest26848-21seq08:06:402
9776998221,23cyclictest0-21swapper/209:02:292
9774998220,23cyclictest0-21swapper/110:25:331
9776998124,23cyclictest25409-21seq08:03:532
9776998122,25cyclictest0-21swapper/211:04:202
9776998122,25cyclictest0-21swapper/211:04:202
976899817,61cyclictest5182-21/usr/sbin/munin08:51:300
9768998159,15cyclictest25686-21latency_hist08:05:140
9768998141,12cyclictest15-21ksoftirqd/008:26:040
976899813,51cyclictest23163-21awk09:25:100
9776998062,9cyclictest0-21swapper/212:06:292
9776998062,9cyclictest0-21swapper/212:06:292
9776998050,20cyclictest27271-21fschecks_count10:25:322
9776998026,29cyclictest23367-21seq10:19:122
9776998024,23cyclictest24695-21seq07:57:492
976899805,36cyclictest15-21ksoftirqd/007:55:510
9768998042,11cyclictest15-21ksoftirqd/008:06:400
9768998028,12cyclictest181rcu_preempt08:20:100
976899802,40cyclictest15-21ksoftirqd/007:20:040
9776997925,19cyclictest24022-21seq11:13:492
9776997924,25cyclictest25754-21seq10:22:282
9776997924,25cyclictest25754-21seq10:22:282
9776997924,25cyclictest1874-21seq11:28:132
9776997923,25cyclictest28106-21seq09:32:132
9776997917,25cyclictest11912-21runrttasks10:54:112
9774997963,9cyclictest0-21swapper/111:11:231
9768997956,16cyclictest13792-21kworker/u19:2+events_unbound10:15:100
9768997956,16cyclictest13792-21kworker/u19:2+events_unbound10:15:100
9768997955,16cyclictest6755-21latency_hist12:30:130
976899795,42cyclictest15-21ksoftirqd/008:13:120
9768997953,17cyclictest23245-21sh12:04:160
976899792,49cyclictest15-21ksoftirqd/007:24:500
976899792,49cyclictest15-21ksoftirqd/007:24:500
9776997836,32cyclictest0-21swapper/211:05:202
9776997822,26cyclictest4311-21seq11:31:332
9776997822,20cyclictest11939-21ssh10:00:152
9776997817,26cyclictest15529-21ssh11:00:102
9774997860,9cyclictest0-21swapper/110:10:451
9774997860,9cyclictest0-21swapper/110:10:451
9774997860,8cyclictest0-21swapper/111:00:431
9774997860,8cyclictest0-21swapper/111:00:431
9774997856,10cyclictest0-21swapper/110:30:361
9774997856,10cyclictest0-21swapper/110:30:361
976899782,44cyclictest15-21ksoftirqd/008:31:260
9783997710,55cyclictest5743-21chrt08:51:353
9776997762,9cyclictest16793-21run-parts10:07:362
9776997759,9cyclictest0-21swapper/210:10:472
9776997759,9cyclictest0-21swapper/210:10:472
9776997724,21cyclictest21566-21seq07:49:232
9776997724,20cyclictest8601-21seq09:55:002
9776997722,19cyclictest16856-21seq09:14:172
9776997722,19cyclictest14285-21seq11:49:212
9776997719,21cyclictest0-21swapper/211:38:432
9774997761,7cyclictest0-21swapper/111:05:301
9774997759,9cyclictest0-21swapper/111:25:421
9768997745,11cyclictest181rcu_preempt11:27:340
9768997735,18cyclictest9755-21cyclictest11:47:460
976899773,42cyclictest15-21ksoftirqd/007:39:320
9776997631,34cyclictest0-21swapper/211:15:252
9776997622,24cyclictest23179-21seq07:54:012
9776997621,24cyclictest14603-21seq07:20:082
9774997657,12cyclictest17639-21systemd-run11:55:101
9774997656,10cyclictest0-21swapper/112:05:131
9768997659,10cyclictest409-21cron12:20:100
9768997659,10cyclictest409-21cron12:20:100
976899763,27cyclictest15-21ksoftirqd/008:44:390
9776997560,9cyclictest28589-21grep11:20:452
9776997560,9cyclictest28589-21grep11:20:452
9776997558,11cyclictest18659-21runrttasks09:15:572
9776997528,32cyclictest23585-21idleruntime-cro12:05:092
9776997518,26cyclictest29722-21runrttasks08:21:142
9774997560,8cyclictest0-21swapper/109:15:361
9774997530,10cyclictest181rcu_preempt07:00:411
976899755,29cyclictest15-21ksoftirqd/007:33:530
9768997551,17cyclictest298-21in:imuxsock11:22:240
9768997551,17cyclictest298-21in:imuxsock11:22:240
976899753,33cyclictest28035-21ps12:11:190
976899752,51cyclictest15-21ksoftirqd/011:56:350
976899752,51cyclictest15-21ksoftirqd/011:56:350
9768997513,38cyclictest15-21ksoftirqd/007:52:140
967927512,39sleep19681-21munin-run07:00:141
978399745,51cyclictest0-21swapper/312:24:553
978399745,51cyclictest0-21swapper/312:24:553
978399743,32cyclictest14280-21chrt10:04:073
978399742,34cyclictest20204-21taskset07:41:403
978399742,34cyclictest20204-21taskset07:41:403
978399742,32cyclictest5418-21chrt11:34:403
978399742,31cyclictest26695-21chrt09:30:303
9776997460,10cyclictest9755-21cyclictest07:45:142
9776997460,10cyclictest9755-21cyclictest07:45:142
9776997458,7cyclictest0-21swapper/208:40:322
9776997427,23cyclictest1142-21seq08:36:162
9776997417,22cyclictest0-21swapper/209:22:202
9776997416,25cyclictest0-21swapper/210:46:332
9774997459,9cyclictest25567-21latency_hist08:05:131
9774997457,11cyclictest21921-21/usr/sbin/munin07:50:381
9774997457,10cyclictest0-21swapper/112:15:331
9774997457,10cyclictest0-21swapper/112:15:331
9774997456,9cyclictest0-21swapper/107:41:351
9774997456,9cyclictest0-21swapper/107:41:351
9774997455,8cyclictest0-21swapper/111:45:141
9774997445,20cyclictest14616-21modprobe07:20:101
976899743,41cyclictest15-21ksoftirqd/009:13:280
976899743,37cyclictest25102-21grep11:15:310
9768997420,25cyclictest15-21ksoftirqd/011:34:330
978399733,32cyclictest23883-21taskset12:05:133
9776997355,12cyclictest1-21systemd07:40:122
9776997336,27cyclictest0-21swapper/207:00:212
9776997325,25cyclictest25004-21seq09:26:582
9776997325,25cyclictest25004-21seq09:26:582
9776997322,20cyclictest12225-21seq07:08:422
9774997356,8cyclictest0-21swapper/110:35:381
9774997355,12cyclictest12514-21latency_hist10:55:131
9774997354,10cyclictest0-21swapper/111:55:431
9774997354,10cyclictest0-21swapper/111:55:431
9768997350,9cyclictest181rcu_preempt08:47:120
9768997350,9cyclictest181rcu_preempt08:47:120
9768997316,8cyclictest0-21swapper/009:33:000
978399723,28cyclictest17173-21chrt09:15:093
9783997210,44cyclictest0-21swapper/310:55:373
9776997257,9cyclictest30724-21ntp_offset12:15:392
9776997257,9cyclictest30724-21ntp_offset12:15:392
9776997253,13cyclictest11610-21grep11:45:102
9776997218,24cyclictest6197-21runrttasks12:29:152
9774997255,8cyclictest0-21swapper/109:55:471
9774997247,18cyclictest0-21swapper/110:00:321
9774997242,23cyclictest0-21swapper/112:06:301
9774997242,23cyclictest0-21swapper/112:06:301
976899728,37cyclictest15-21ksoftirqd/007:14:130
976899726,52cyclictest12311-21apt-config10:55:100
9768997254,12cyclictest8172-21diskmemload11:00:300
9768997254,12cyclictest8172-21diskmemload11:00:300
976899723,41cyclictest3277-21awk10:40:100
976899723,38cyclictest15-21ksoftirqd/008:56:420
976899723,30cyclictest17479-21/usr/sbin/munin09:15:450
976899722,51cyclictest3572-21ntp_kernel_err09:45:390
976899722,40cyclictest15-21ksoftirqd/008:37:010
9776997154,11cyclictest15609-21switchtime07:20:442
9776997154,11cyclictest15609-21switchtime07:20:442
9776997150,15cyclictest4922-21latency_hist08:50:142
9776997150,15cyclictest4922-21latency_hist08:50:142
9776997119,10cyclictest31065-21grep10:30:472
9776997119,10cyclictest31065-21grep10:30:472
9774997153,9cyclictest0-21swapper/109:10:291
977499712,31cyclictest0-21swapper/110:44:541
9768997150,8cyclictest181rcu_preempt11:12:380
9768997142,12cyclictest181rcu_preempt09:40:450
9768997141,21cyclictest6628-21sh11:35:420
9768997138,7cyclictest181rcu_preempt09:55:120
9768997122,37cyclictest6296-21systemctl10:45:110
978399702,34cyclictest15613-21chrt10:05:413
9776997051,14cyclictest9817-21latency_hist07:00:152
9776997023,24cyclictest27653-21seq08:13:282
9776997020,22cyclictest352-21runrttasks10:42:522
9774997048,16cyclictest3093-21cut12:24:221
9774997048,16cyclictest3093-21cut12:24:221
9774997046,16cyclictest32724-21cut09:40:311
9774997019,19cyclictest0-21swapper/110:21:031
9774997019,19cyclictest0-21swapper/110:21:031
9768997049,8cyclictest181rcu_preempt10:25:490
9768997048,9cyclictest181rcu_preempt10:30:270
9768997048,9cyclictest181rcu_preempt10:30:270
976899702,41cyclictest9359-21taskset09:00:460
976899702,24cyclictest24593-21vmstat09:25:490
976899702,24cyclictest24593-21vmstat09:25:490
978399694,29cyclictest16264-21chrt11:00:343
978399694,29cyclictest16264-21chrt11:00:343
978399693,30cyclictest4722-21chrt12:26:013
9776996921,26cyclictest0-21swapper/209:38:012
9776996921,26cyclictest0-21swapper/209:38:012
9774996953,9cyclictest0-21swapper/110:45:481
9774996953,10cyclictest3053-21cron08:45:111
9774996951,13cyclictest24272-21sh09:25:451
9774996951,13cyclictest24272-21sh09:25:451
9774996948,14cyclictest5918-21latency_hist09:50:141
9774996947,15cyclictest300-21rs:main1
9774996947,13cyclictest8172-21diskmemload09:20:421
9774996939,14cyclictest30838-21kworker/u17:1-nfsiod10:07:061
976899693,39cyclictest15-21ksoftirqd/009:40:130
976899693,39cyclictest15-21ksoftirqd/009:40:130
9768996933,12cyclictest181rcu_preempt07:25:590
9768996927,16cyclictest181rcu_preempt10:22:530
9768996927,16cyclictest181rcu_preempt10:22:530
9768996910,21cyclictest15-21ksoftirqd/010:08:360
978399683,32cyclictest31292-21chrt10:31:113
978399683,32cyclictest31292-21chrt10:31:113
978399683,29cyclictest1892-21chrt11:28:163
978399683,27cyclictest16664-21chrt11:52:323
978399683,26cyclictest10091-21chrt07:00:273
9776996846,16cyclictest8172-21diskmemload09:40:442
9774996852,11cyclictest0-21swapper/112:14:231
9774996841,20cyclictest6711-21kworker/u18:0+nfsiod11:34:581
977499683,56cyclictest12276-21apt-get10:55:241
9768996838,8cyclictest181rcu_preempt10:15:300
976899682,36cyclictest19674-21switchtime11:05:440
9768996822,34cyclictest25264-21wc12:06:410
9768996822,34cyclictest25264-21wc12:06:410
978399673,28cyclictest11625-21chrt11:45:103
9774996753,9cyclictest18176-21kworker/u17:3-rpciod09:06:581
9774996747,14cyclictest11217-21sh09:05:131
9774996746,14cyclictest8606-21latency_hist11:40:131
9774996740,21cyclictest21042-21/usr/sbin/munin10:15:451
9774996737,21cyclictest19161-21cron07:40:101
9768996751,10cyclictest15024-21diskmemload11:50:260
9768996724,8cyclictest0-21swapper/010:01:110
978399663,29cyclictest2681-21taskset09:45:103
9774996624,32cyclictest27968-21latency_hist08:15:131
9774996621,25cyclictest13067-21ssh11:45:541
977499660,25cyclictest8172-21diskmemload12:25:481
9768996638,8cyclictest181rcu_preempt11:40:200
978399654,43cyclictest9903-21taskset10:50:333
978399654,26cyclictest20524-21chrt10:14:373
978399654,26cyclictest20524-21chrt10:14:373
978399653,30cyclictest10752-21chrt09:04:033
978399653,28cyclictest8058-21chrt10:46:523
978399653,25cyclictest23223-21taskset11:11:333
978399652,24cyclictest30395-21chrt11:24:553
978399652,24cyclictest30395-21chrt11:24:553
978399652,16cyclictest9204-21chrt09:55:313
977699653,36cyclictest32340-21unin-run08:35:122
9774996545,15cyclictest6629-21sh09:50:411
9774996545,14cyclictest456-21kernelversion08:35:321
978399644,11cyclictest0-21swapper/310:35:223
978399643,23cyclictest13888-21chrt07:14:043
9783996429,11cyclictest0-21swapper/312:05:343
9783996429,11cyclictest0-21swapper/312:05:343
978399642,25cyclictest24973-21chrt10:20:453
978399642,25cyclictest24973-21chrt10:20:453
9776996428,27cyclictest18102-21head07:30:472
9774996449,8cyclictest0-21swapper/108:51:441
9774996429,28cyclictest26696-21sh09:30:301
144532640,5sleep30-21swapper/311:49:483
978399633,25cyclictest22298-21chrt07:50:353
978399633,23cyclictest6327-21chrt11:35:343
978399633,23cyclictest22576-21chrt09:23:333
9774996350,8cyclictest0-21swapper/107:05:231
9774996345,11cyclictest30716-21latency08:25:371
9774996344,14cyclictest9755-21cyclictest08:15:271
9774996343,14cyclictest32140-21latency_hist09:40:131
9774996343,14cyclictest32140-21latency_hist09:40:131
9774996343,12cyclictest0-21swapper/107:35:141
978399623,24cyclictest30884-21chrt09:36:383
978399623,24cyclictest30884-21chrt09:36:383
978399623,24cyclictest22778-21chrt10:17:333
978399623,23cyclictest30849-21chrt12:15:433
978399623,23cyclictest30849-21chrt12:15:433
978399623,22cyclictest26910-21chrt11:18:303
978399623,21cyclictest17508-21chrt09:15:223
978399622,24cyclictest28608-21taskset10:27:063
978399622,22cyclictest3029-21chrt09:45:263
9774996247,9cyclictest12713-21cpuspeed07:10:271
977499624,43cyclictest7744-21grep08:55:471
977499624,37cyclictest24807-21/usr/sbin/munin11:15:311
9774996241,15cyclictest3562-21fschecks_time08:45:341
9774996241,15cyclictest3562-21fschecks_time08:45:341
977499623,42cyclictest352-21runrttasks08:24:261
978399613,23cyclictest20841-21chrt11:08:213
978399613,22cyclictest25023-21chrt09:27:023
978399613,22cyclictest25023-21chrt09:27:023
978399613,20cyclictest29881-21chrt08:23:193
978399613,12cyclictest30757-21chrt08:25:383
978399612,22cyclictest12891-21chrt09:06:383
978399612,21cyclictest12085-21chrt07:06:593
978399612,20cyclictest6902-21chrt09:50:453
978399612,19cyclictest17927-21chrt11:55:203
978399612,19cyclictest17927-21chrt11:55:203
9783996111,41cyclictest0-21swapper/307:30:443
9776996126,27cyclictest16943-21cat07:30:122
977499613,40cyclictest17065-21latency_hist07:30:131
977499612,46cyclictest23587-21cpu07:55:261
978399609,42cyclictest0-21swapper/308:20:103
978399604,20cyclictest24592-21chrt07:56:273
978399604,20cyclictest18835-21chrt07:35:553
978399604,11cyclictest4596-21chrt10:40:483
978399603,20cyclictest16543-21chrt07:26:153
978399603,19cyclictest27461-21chrt08:10:563
978399603,19cyclictest26867-21chrt08:06:553
978399602,23cyclictest29845-21chrt12:15:113
978399602,21cyclictest7835-21chrt08:56:093
978399602,19cyclictest21395-21chrt07:47:073
9783996011,40cyclictest0-21swapper/307:20:443
9783996011,40cyclictest0-21swapper/307:20:443
977499603,40cyclictest26539-21switchtime08:05:431
978399593,19cyclictest14327-21chrt07:16:313
978399593,18cyclictest4337-21chrt08:45:593
978399593,18cyclictest4337-21chrt08:45:593
978399593,18cyclictest2805-21chrt08:41:583
9783995912,39cyclictest0-21swapper/308:35:283
978399583,18cyclictest25346-21chrt08:03:033
9774995842,9cyclictest0-21swapper/107:50:101
978399572,20cyclictest32091-21chrt08:32:353
978399556,14cyclictest0-21swapper/307:00:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional