You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 20:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Jun 18, 2026 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9297219470,18sleep30-21swapper/306:54:093
990321094,20sleep29958-21wc06:54:342
106389910357,8cyclictest181rcu_preempt07:14:131
106389910357,8cyclictest181rcu_preempt07:14:131
93132998,65sleep19319-21/usr/sbin/munin06:54:121
245522980,6sleep20-21swapper/207:39:162
10634999619,41cyclictest26874-21ssh09:12:520
10634999619,41cyclictest26874-21ssh09:12:520
10638999468,9cyclictest181rcu_preempt09:14:171
10638999461,8cyclictest181rcu_preempt08:04:051
10638999254,8cyclictest181rcu_preempt07:39:171
10634999271,15cyclictest5884-21sh10:25:200
10634999271,15cyclictest5884-21sh10:25:200
10638998837,11cyclictest0-21swapper/107:21:541
10638998837,11cyclictest0-21swapper/107:21:541
10634998817,46cyclictest0-21swapper/008:50:290
10644998760,18cyclictest31438-21gpgv11:08:542
10644998748,9cyclictest181rcu_preempt10:19:002
10638998667,10cyclictest31817-21ssh12:03:121
10638998655,11cyclictest181rcu_preempt10:44:211
10634998667,13cyclictest18002-21diskmemload10:04:230
10644998557,22cyclictest12155-21fschecks_time12:24:092
10638998555,8cyclictest181rcu_preempt11:04:031
10638998549,18cyclictest181rcu_preempt10:19:241
10638998548,12cyclictest181rcu_preempt07:49:251
10634998554,10cyclictest0-21swapper/012:19:250
10634998526,19cyclictest1592-21latency_hist08:08:510
1063499851,39cyclictest0-21swapper/007:48:520
10638998443,17cyclictest181rcu_preempt08:35:101
1063499849,23cyclictest7019-21users12:14:280
10634998410,36cyclictest22403-21users09:04:280
10638998347,7cyclictest181rcu_preempt11:14:231
10638998347,7cyclictest181rcu_preempt11:14:231
10638998324,13cyclictest0-21swapper/108:13:481
10634998363,14cyclictest16468-21latency_hist10:43:510
10644998251,9cyclictest181rcu_preempt07:34:042
10638998253,8cyclictest181rcu_preempt07:13:511
10638998253,8cyclictest181rcu_preempt07:13:511
10634998264,12cyclictest14579-21sendmail12:28:490
1063499824,36cyclictest20071-21tune2fs10:49:110
1064499818,47cyclictest18002-21diskmemload11:09:062
10644998154,18cyclictest15483-21sh11:34:262
10638998151,8cyclictest181rcu_preempt11:24:111
10638998151,8cyclictest181rcu_preempt11:24:111
10638998143,9cyclictest181rcu_preempt07:59:351
10638998141,10cyclictest181rcu_preempt12:24:081
10638998136,9cyclictest0-21swapper/107:48:531
10634998160,15cyclictest300-21rs:main0
10634998160,13cyclictest32348-21ssh12:04:000
10634998157,18cyclictest8896-21open_inodes08:29:200
1063499812,58cyclictest11832-21/usr/sbin/munin11:29:130
10638998048,7cyclictest181rcu_preempt12:17:581
10634998058,15cyclictest300-21rs:main0
10634998025,32cyclictest5612-21ssh12:13:490
10634998016,15cyclictest10077-21ssh09:39:050
10644997965,10cyclictest10624-21cyclictest07:04:292
1064499793,38cyclictest19226-21df09:54:082
1064499793,38cyclictest19226-21df09:54:082
1064499792,53cyclictest23993-21apt-get09:09:082
1064499792,53cyclictest23993-21apt-get09:09:082
1064499792,50cyclictest9839-21grep08:33:532
1063899795,42cyclictest31-21ksoftirqd/110:25:141
1063899795,42cyclictest31-21ksoftirqd/110:25:141
10638997946,12cyclictest181rcu_preempt07:08:531
10638997941,9cyclictest0-21swapper/110:54:231
1063499795,33cyclictest20193-21/usr/sbin/munin07:24:260
1063499793,44cyclictest19177-21switchtime08:59:240
10634997920,19cyclictest22008-21/usr/sbin/munin09:59:080
10634997919,39cyclictest31138-21ssh09:19:190
10634997913,9cyclictest4840-21munin-run08:18:490
10634997913,30cyclictest8032-21unixbench_multi09:34:240
1064499787,44cyclictest58-21kcompactd007:54:512
1064499787,44cyclictest58-21kcompactd007:54:512
10644997854,15cyclictest2374-21systemd-journal10:35:002
10644997843,12cyclictest181rcu_preempt09:53:492
10644997838,14cyclictest181rcu_preempt10:54:152
1064499782,48cyclictest425-21tune2fs08:04:102
1064499782,39cyclictest3399-21latency12:09:132
10638997849,9cyclictest18002-21diskmemload10:03:301
10638997848,8cyclictest181rcu_preempt08:39:221
10638997847,9cyclictest4456-21ssh12:10:371
10634997857,15cyclictest16752-21ssh11:37:530
1063499783,41cyclictest12998-21latency_hist08:43:520
10634997821,14cyclictest27019-21sh11:54:190
10644997757,8cyclictest181rcu_preempt07:49:062
10644997750,10cyclictest181rcu_preempt11:48:592
10644997750,10cyclictest181rcu_preempt11:48:592
10644997745,23cyclictest25954-21cut07:44:112
10638997760,10cyclictest6249-21kworker/u17:3-rpciod09:50:341
10638997753,10cyclictest181rcu_preempt11:03:051
10638997753,10cyclictest181rcu_preempt11:03:051
10638997752,8cyclictest181rcu_preempt07:24:101
1063899772,45cyclictest31-21ksoftirqd/111:38:121
10634997760,11cyclictest15312-21timerwakeupswit07:09:240
10634997760,11cyclictest15312-21timerwakeupswit07:09:240
10634997759,11cyclictest58-21kcompactd007:39:070
10634997758,13cyclictest30574-21cron07:58:490
10634997758,13cyclictest30574-21cron07:58:490
10634997757,14cyclictest29200-21sshd09:16:000
10634997756,13cyclictest8625-21diskmemload11:24:090
10634997756,13cyclictest8625-21diskmemload11:24:090
10634997715,35cyclictest20923-21/usr/sbin/munin07:29:180
1063499771,33cyclictest0-21swapper/009:30:500
10644997648,11cyclictest181rcu_preempt08:27:072
1064499764,46cyclictest13371-21fschecks_count08:44:112
1064499763,38cyclictest17011-21fschecks_time10:44:112
10644997629,12cyclictest58-21kcompactd010:40:372
10638997658,13cyclictest352-21runrttasks12:23:491
10638997654,8cyclictest181rcu_preempt10:35:351
1063499769,29cyclictest352-21runrttasks09:50:570
1063499767,28cyclictest30256-21/usr/sbin/munin11:59:250
10634997622,33cyclictest22528-21/usr/sbin/munin07:34:170
10634997621,31cyclictest0-21swapper/010:14:240
10634997613,38cyclictest1843-21fschecks_time10:19:110
10644997558,8cyclictest0-21swapper/209:14:262
10644997549,9cyclictest181rcu_preempt08:14:062
10644997544,11cyclictest181rcu_preempt07:58:572
10644997532,9cyclictest181rcu_preempt11:18:532
10644997515,24cyclictest5573-21awk08:19:152
10638997559,9cyclictest0-21swapper/109:28:491
10638997551,8cyclictest181rcu_preempt11:19:201
10638997546,7cyclictest181rcu_preempt08:58:531
10638997546,7cyclictest181rcu_preempt08:58:531
10638997535,18cyclictest0-21swapper/110:49:171
10638997532,9cyclictest3894-21latency08:14:151
1063899752,40cyclictest31-21ksoftirqd/111:58:381
10638997523,12cyclictest0-21swapper/110:42:201
1063499755,38cyclictest352-21runrttasks10:13:330
10634997551,16cyclictest18002-21diskmemload10:45:500
1063499754,40cyclictest25696-21/usr/sbin/munin10:59:210
1063499754,40cyclictest25696-21/usr/sbin/munin10:59:210
10634997518,11cyclictest0-21swapper/007:14:120
10634997518,11cyclictest0-21swapper/007:14:120
10644997446,19cyclictest15334-21cut08:50:222
10644997438,17cyclictest181rcu_preempt09:29:102
10638997452,8cyclictest181rcu_preempt08:24:231
1063499744,57cyclictest20524-21cstates11:44:050
10634997419,17cyclictest17572-21unixbench_multi08:54:260
10634997419,17cyclictest17572-21unixbench_multi08:54:260
10634997417,11cyclictest1992-21expr09:24:260
10634997416,23cyclictest5077-21/usr/sbin/munin08:19:130
1063499741,39cyclictest21713-21kworker/u17:3+rpciod10:29:150
10644997358,10cyclictest10624-21cyclictest10:06:562
10644997349,16cyclictest0-21swapper/209:28:422
10644997344,10cyclictest181rcu_preempt11:24:042
10644997344,10cyclictest181rcu_preempt11:24:042
10644997342,11cyclictest181rcu_preempt09:35:542
1064499733,40cyclictest21047-21latency_hist09:03:512
1064499733,31cyclictest18002-21diskmemload11:18:522
10638997351,8cyclictest181rcu_preempt10:10:321
10638997345,11cyclictest181rcu_preempt09:47:181
10638997336,9cyclictest0-21swapper/109:00:291
10638997336,8cyclictest181rcu_preempt09:19:001
10638997331,8cyclictest0-21swapper/111:28:591
10638997326,13cyclictest0-21swapper/108:49:381
1063499739,28cyclictest31460-21runrttasks11:08:500
10634997356,11cyclictest3008-21ssh11:14:170
10634997356,11cyclictest3008-21ssh11:14:170
10634997338,26cyclictest0-21swapper/006:58:540
1063499733,55cyclictest13634-21latency_hist10:38:530
10634997323,30cyclictest0-21swapper/011:10:580
10634997318,24cyclictest25172-21ssh10:58:120
10634997317,24cyclictest19612-21ssh09:54:180
10634997317,24cyclictest19612-21ssh09:54:180
10634997316,27cyclictest9923-21/usr/sbin/munin08:34:120
10644997250,15cyclictest10624-21cyclictest11:22:542
10644997246,20cyclictest28926-21timerandwakeup10:09:242
10644997244,18cyclictest0-21swapper/212:08:512
10644997235,22cyclictest0-21swapper/210:24:092
10644997235,22cyclictest0-21swapper/210:24:092
10644997234,13cyclictest18319-21grep07:19:222
10644997234,13cyclictest18319-21grep07:19:222
10644997232,15cyclictest181rcu_preempt07:03:522
10644997231,16cyclictest181rcu_preempt12:02:042
1064499722,41cyclictest11649-21/usr/sbin/munin11:29:102
10638997253,13cyclictest9732-21latency_hist09:38:531
10638997251,8cyclictest181rcu_preempt07:34:051
10638997238,11cyclictest0-21swapper/106:59:091
10638997238,10cyclictest0-21swapper/111:50:401
10638997238,10cyclictest0-21swapper/111:50:401
10638997231,10cyclictest0-21swapper/109:08:361
1063499724,58cyclictest23422-21ssh11:49:010
1063499724,58cyclictest23422-21ssh11:49:010
10634997212,23cyclictest13147-21/usr/sbin/munin08:44:170
10644997144,19cyclictest0-21swapper/211:54:252
10644997138,13cyclictest181rcu_preempt08:13:522
10644997136,12cyclictest181rcu_preempt08:54:252
10644997136,12cyclictest181rcu_preempt08:54:252
10644997133,8cyclictest181rcu_preempt09:04:112
10644997124,15cyclictest0-21swapper/211:48:512
10638997156,10cyclictest10624-21cyclictest09:57:461
10638997156,10cyclictest10624-21cyclictest09:57:461
10638997148,8cyclictest181rcu_preempt08:31:061
10638997147,17cyclictest31257-21ssh10:14:121
10638997143,12cyclictest181rcu_preempt10:33:161
1063899713,46cyclictest352-21runrttasks11:09:251
10634997128,35cyclictest0-21swapper/011:19:070
10634997128,33cyclictest17423-21apt-get11:39:010
10634997128,33cyclictest17423-21apt-get11:39:010
10634997120,11cyclictest0-21swapper/007:23:520
10634997120,11cyclictest0-21swapper/007:23:520
10634997119,15cyclictest12265-21latency_hist07:03:520
10644997015,10cyclictest0-21swapper/207:24:052
10638997048,14cyclictest14809-21apt-key08:48:541
10638997047,7cyclictest181rcu_preempt10:08:221
10638997043,10cyclictest181rcu_preempt11:44:031
10638997040,10cyclictest181rcu_preempt11:39:131
10638997040,10cyclictest181rcu_preempt11:39:131
10638997031,17cyclictest181rcu_preempt12:08:141
1063499704,35cyclictest13459-21kernelversion09:44:150
10634997022,8cyclictest0-21swapper/008:28:490
10634997016,18cyclictest2973-21chrt08:10:410
10644996944,12cyclictest181rcu_preempt11:02:492
10644996944,12cyclictest181rcu_preempt11:02:492
1064499693,21cyclictest6317-21uname12:14:142
10644996915,16cyclictest17442-21idleruntime-cro07:18:492
10644996915,16cyclictest17442-21idleruntime-cro07:18:492
10638996945,10cyclictest181rcu_preempt09:41:291
10638996934,9cyclictest0-21swapper/107:55:031
10638996934,9cyclictest0-21swapper/107:55:031
10644996832,12cyclictest181rcu_preempt09:59:142
1064499682,33cyclictest11296-21latency_hist08:38:492
10644996822,13cyclictest0-21swapper/207:29:122
10638996833,9cyclictest0-21swapper/107:29:121
1063499688,37cyclictest15-21ksoftirqd/008:00:120
10644996750,13cyclictest10624-21cyclictest10:14:262
1064499672,36cyclictest6471-21kworker/2:2+mm_percpu_wq09:23:312
10644996723,12cyclictest181rcu_preempt09:46:532
10638996730,9cyclictest0-21swapper/108:18:531
10644996650,9cyclictest0-21swapper/209:39:262
1064499664,51cyclictest7790-21ssh10:29:022
10644996634,12cyclictest181rcu_preempt11:39:142
10644996634,12cyclictest181rcu_preempt11:39:142
1064499662,44cyclictest9171-21tune2fs12:19:102
10638996636,10cyclictest181rcu_preempt09:30:021
10638996621,7cyclictest0-21swapper/109:09:081
10638996621,7cyclictest0-21swapper/109:09:081
10650996549,11cyclictest451rcuc/312:14:203
10644996541,11cyclictest181rcu_preempt07:09:212
10644996541,11cyclictest181rcu_preempt07:09:212
1064499633,27cyclictest18002-21diskmemload10:49:232
1064499633,24cyclictest352-21runrttasks08:39:572
10650996148,9cyclictest451rcuc/311:22:293
10650996045,10cyclictest451rcuc/312:03:553
10650995938,14cyclictest451rcuc/311:57:063
1065099593,44cyclictest19972-21taskset11:43:313
1065099593,44cyclictest19972-21taskset11:43:313
10650995845,9cyclictest451rcuc/310:39:003
1065099575,42cyclictest0-21swapper/307:54:173
1065099575,42cyclictest0-21swapper/307:54:173
10650995745,8cyclictest451rcuc/307:45:293
10650995643,9cyclictest451rcuc/309:04:493
1065099563,40cyclictest6594-21taskset08:23:523
1065099554,37cyclictest23545-21taskset11:49:073
1065099554,37cyclictest23545-21taskset11:49:073
10650995542,9cyclictest451rcuc/306:59:033
10650995541,9cyclictest451rcuc/308:37:383
10650995540,10cyclictest451rcuc/309:22:043
10650995539,11cyclictest451rcuc/309:14:013
1065099553,37cyclictest18943-21chrt09:53:533
1065099552,43cyclictest13048-21taskset10:37:463
10650995441,9cyclictest451rcuc/311:11:433
10650995441,9cyclictest451rcuc/310:06:303
1065099543,37cyclictest4436-21chrt09:29:133
1065099534,36cyclictest15962-21taskset08:50:383
1065099534,34cyclictest18965-21taskset08:59:213
10650995341,8cyclictest451rcuc/308:56:423
10650995341,8cyclictest451rcuc/308:56:423
10650995337,9cyclictest451rcuc/307:50:023
1065099533,36cyclictest1063-21taskset08:04:243
1065099532,42cyclictest9138-21taskset11:24:233
1065099532,42cyclictest9138-21taskset11:24:233
1065099532,42cyclictest24623-21chrt09:09:103
1065099532,42cyclictest24623-21chrt09:09:103
1065099524,33cyclictest16845-21chrt07:14:263
1065099524,33cyclictest16845-21chrt07:14:263
10650995238,10cyclictest451rcuc/308:17:543
1065099523,36cyclictest22663-21taskset07:34:063
1065099523,35cyclictest24300-21taskset10:02:443
1065099523,33cyclictest25423-21taskset07:43:053
1065099522,40cyclictest7070-21chrt09:34:033
1065099513,35cyclictest3395-21chrt12:09:133
1065099513,35cyclictest28472-21chrt11:03:523
1065099513,35cyclictest28472-21chrt11:03:523
1065099513,35cyclictest2249-21chrt08:09:143
1065099512,39cyclictest17419-21taskset10:44:223
1065099512,36cyclictest3030-21chrt11:14:173
1065099512,36cyclictest3030-21chrt11:14:173
1065099512,35cyclictest6763-21taskset08:24:053
1065099504,33cyclictest17971-21taskset07:19:123
1065099504,33cyclictest17971-21taskset07:19:123
10650995038,8cyclictest451rcuc/307:24:313
10650995036,9cyclictest451rcuc/308:48:033
1065099503,36cyclictest12817-21chrt09:43:523
1065099503,35cyclictest12695-21chrt07:04:013
1065099503,33cyclictest28730-21chrt11:04:043
1065099503,30cyclictest13111-21chrt08:43:533
10650995014,31cyclictest0-21swapper/310:24:053
10650995014,31cyclictest0-21swapper/310:24:053
1065099494,35cyclictest31611-21chrt10:14:193
1065099493,36cyclictest15813-21chrt07:13:493
1065099493,36cyclictest15813-21chrt07:13:493
1065099493,36cyclictest14455-21chrt11:34:033
1065099493,31cyclictest11833-21chrt12:23:563
1065099492,34cyclictest22469-21chrt10:53:513
1065099492,32cyclictest9857-21chrt08:33:533
10650994835,9cyclictest451rcuc/310:12:463
1065099483,36cyclictest20262-21chrt09:54:463
1065099483,36cyclictest20262-21chrt09:54:463
1065099483,33cyclictest24086-21taskset10:55:083
1065099483,32cyclictest20410-21chrt11:44:003
10650994735,8cyclictest451rcuc/307:29:183
10650994734,9cyclictest451rcuc/307:59:443
1065099473,35cyclictest31919-21taskset12:03:293
1065099473,32cyclictest2743-21taskset09:26:053
1065099464,32cyclictest10429-21taskset10:33:493
1065099463,30cyclictest10060-21chrt12:19:383
1065099462,32cyclictest12410-21chrt11:29:253
1065099453,33cyclictest1979-21chrt10:19:143
1065099453,32cyclictest15352-21chrt09:47:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional