You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 20:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot4.osadl.org (updated Fri Nov 28, 2025 12:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
211892710,5sleep10-21swapper/100:52:121
205972657,19sleep30-21swapper/300:52:033
2185625912,17sleep20-21swapper/200:54:192
2232899574,47cyclictest0-21swapper/302:32:063
2232899564,46cyclictest0-21swapper/303:00:143
2232899554,45cyclictest0-21swapper/306:01:483
2232899554,45cyclictest0-21swapper/306:01:483
2230999554,45cyclictest0-21swapper/005:46:590
2230999553,46cyclictest0-21swapper/004:22:520
2232899543,45cyclictest12430-21latency_hist03:11:443
2230999543,45cyclictest0-21swapper/002:59:210
2230999542,7cyclictest16457-21memory03:17:030
2232899534,44cyclictest0-21swapper/305:22:313
2230999533,5cyclictest0-21swapper/004:39:020
22309995323,26cyclictest2393-21cut06:21:560
2232899529,37cyclictest18650-21/usr/sbin/munin02:12:063
22328995211,35cyclictest29066-21/usr/sbin/munin03:37:113
2230999524,41cyclictest0-21swapper/003:58:420
2232899517,38cyclictest12036-21sendmail_mailqu01:52:113
2232899517,38cyclictest0-21swapper/306:20:093
2232899514,41cyclictest0-21swapper/303:12:333
2232899514,41cyclictest0-21swapper/303:12:333
2232899514,41cyclictest0-21swapper/301:57:023
2232899513,43cyclictest0-21swapper/304:03:523
22328995119,26cyclictest378-21systemd-journal05:17:153
2230999515,40cyclictest0-21swapper/006:12:030
2230999514,42cyclictest0-21swapper/003:02:250
2230999514,41cyclictest0-21swapper/005:15:150
2230999514,14cyclictest0-21swapper/003:29:460
2230999513,44cyclictest0-21swapper/005:05:410
2230999513,44cyclictest0-21swapper/005:05:410
2232899506,38cyclictest0-21swapper/303:48:483
2232899505,39cyclictest0-21swapper/302:51:593
2232899504,41cyclictest0-21swapper/304:52:113
2232899504,12cyclictest0-21swapper/305:33:183
22328995039,7cyclictest22324-21aten_rbpower_en00:56:473
2230999504,40cyclictest0-21swapper/004:31:170
2230999504,40cyclictest0-21swapper/004:16:100
2230999504,40cyclictest0-21swapper/003:21:540
2230999503,42cyclictest0-21swapper/006:11:100
2230999503,42cyclictest0-21swapper/006:11:100
2230999503,41cyclictest0-21swapper/004:53:410
22309995012,32cyclictest0-21swapper/003:12:590
22309995012,32cyclictest0-21swapper/003:12:590
22309995010,7cyclictest8280-21missed_timers04:47:030
2232899497,36cyclictest0-21swapper/303:19:133
2232899497,35cyclictest25019-21/usr/sbin/munin04:22:013
2232899496,37cyclictest15375-21taskset04:07:023
2232899496,37cyclictest15375-21taskset04:07:023
2232899495,39cyclictest0-21swapper/303:52:333
2232899495,38cyclictest0-21swapper/306:11:573
2232899495,38cyclictest0-21swapper/304:50:523
2232899493,40cyclictest0-21swapper/304:35:523
2230999494,39cyclictest0-21swapper/006:18:370
2230999494,39cyclictest0-21swapper/005:34:180
2230999494,39cyclictest0-21swapper/004:02:410
2230999494,39cyclictest0-21swapper/003:10:170
2230999493,41cyclictest0-21swapper/005:55:200
2230999493,41cyclictest0-21swapper/005:20:510
2230999493,41cyclictest0-21swapper/004:08:220
2230999493,41cyclictest0-21swapper/004:08:220
2230999493,40cyclictest0-21swapper/005:22:210
2230999493,40cyclictest0-21swapper/004:34:180
2230999492,41cyclictest10666-21kworker/0:103:49:230
22309994916,28cyclictest19043-21cut05:56:540
22309994911,5cyclictest0-21swapper/005:08:430
22309994911,32cyclictest0-21swapper/001:12:160
22309994910,6cyclictest0-21swapper/005:42:510
2232899486,37cyclictest0-21swapper/305:11:273
2232899486,36cyclictest0-21swapper/303:59:443
2232899484,8cyclictest0-21swapper/305:14:313
2232899484,38cyclictest0-21swapper/305:37:073
2232899484,38cyclictest0-21swapper/302:36:553
2232899484,38cyclictest0-21swapper/302:07:123
2232899483,40cyclictest0-21swapper/303:04:433
22328994812,30cyclictest0-21swapper/303:28:383
22328994811,5cyclictest0-21swapper/304:28:383
22328994811,31cyclictest0-21swapper/305:48:083
2232299489,33cyclictest0-21swapper/204:42:022
2232299484,37cyclictest0-21swapper/204:12:022
2230999484,38cyclictest0-21swapper/006:04:300
2230999484,38cyclictest0-21swapper/006:04:300
2230999484,38cyclictest0-21swapper/005:28:070
2230999484,38cyclictest0-21swapper/004:44:240
2230999484,38cyclictest0-21swapper/003:33:120
2230999483,41cyclictest0-21swapper/003:36:530
2230999483,40cyclictest0-21swapper/001:26:570
2230999483,39cyclictest0-21swapper/003:42:170
2232899477,7cyclictest0-21swapper/303:23:123
2232899476,36cyclictest0-21swapper/304:12:513
2232899476,35cyclictest14070-21ksmtuned04:56:533
2232899476,16cyclictest0-21swapper/304:43:053
2232899474,38cyclictest0-21swapper/305:27:203
2232899474,38cyclictest0-21swapper/302:02:113
2232899474,38cyclictest0-21swapper/302:02:113
2232899474,38cyclictest0-21swapper/301:47:163
2232899474,37cyclictest0-21swapper/303:42:043
2232899474,11cyclictest0-21swapper/301:41:453
22328994732,10cyclictest0-21swapper/306:10:403
22328994732,10cyclictest0-21swapper/306:10:403
22328994711,31cyclictest0-21swapper/303:34:363
2231399473,39cyclictest0-21swapper/104:46:591
2230999475,37cyclictest0-21swapper/004:18:430
2230999474,38cyclictest0-21swapper/001:37:080
2230999474,37cyclictest0-21swapper/005:38:560
2230999474,37cyclictest0-21swapper/004:59:400
2230999474,37cyclictest0-21swapper/001:17:130
2230999473,40cyclictest0-21swapper/003:53:230
2232899468,32cyclictest0-21swapper/302:22:063
2232899466,16cyclictest0-21swapper/306:25:253
2232899465,35cyclictest0-21swapper/305:52:103
2232899464,8cyclictest0-21swapper/305:44:103
2232899464,37cyclictest0-21swapper/304:19:343
2232899464,37cyclictest0-21swapper/301:17:143
2232899463,38cyclictest0-21swapper/305:04:113
2232899463,38cyclictest0-21swapper/305:04:113
2232899463,38cyclictest0-21swapper/302:26:543
22328994610,31cyclictest0-21swapper/304:39:473
22313994637,5cyclictest21-21ksoftirqd/102:56:441
2230999469,32cyclictest0-21swapper/000:57:020
2230999463,38cyclictest0-21swapper/001:31:560
2230999463,10cyclictest26795-21cpu01:06:590
2232899454,36cyclictest0-21swapper/305:57:013
2232899454,36cyclictest0-21swapper/302:47:263
2230999453,9cyclictest0-21swapper/001:41:540
2230999452,37cyclictest24789-21/usr/sbin/munin01:02:080
2232899446,33cyclictest20524-21/usr/sbin/munin02:17:003
2232899443,36cyclictest0-21swapper/301:33:233
2232899443,36cyclictest0-21swapper/301:16:383
2232899443,36cyclictest0-21swapper/301:01:533
2232899443,35cyclictest3012-21unixbench_singl01:27:183
22309994410,5cyclictest0-21swapper/001:25:460
2232899433,8cyclictest0-21swapper/301:42:013
2232899433,34cyclictest30253-21perl02:41:583
22313994334,5cyclictest21-21ksoftirqd/104:41:411
22313994334,5cyclictest21-21ksoftirqd/103:56:421
2231399433,34cyclictest27713-21ssh06:10:271
2231399433,34cyclictest27713-21ssh06:10:271
2232899424,34cyclictest0-21swapper/301:07:053
2232899424,33cyclictest0-21swapper/301:23:533
179342423,7sleep10-21swapper/104:11:481
111902423,6sleep20-21swapper/203:08:022
2232299412,34cyclictest23417-21iostat_ios00:57:042
2231399412,23cyclictest155252sh04:58:011
136292413,6sleep10-21swapper/105:47:191
22313994031,5cyclictest21-21ksoftirqd/101:36:451
22309994030,5cyclictest3-21ksoftirqd/002:06:440
22309994030,5cyclictest3-21ksoftirqd/002:06:440
133912403,6sleep20-21swapper/204:03:362
273202393,6sleep10-21swapper/103:35:101
2231399393,32cyclictest0-21swapper/105:05:141
2231399393,32cyclictest0-21swapper/105:05:141
96152383,6sleep20-21swapper/204:48:562
74212383,6sleep20-21swapper/205:37:502
56042383,6sleep10-21swapper/101:36:591
3392383,6sleep20-21swapper/204:34:472
308672383,6sleep10-21swapper/101:17:031
232082383,6sleep10-21swapper/104:19:211
2232299384,30cyclictest0-21swapper/206:25:392
22313993826,7cyclictest16149-21cut03:16:581
2231399381,17cyclictest22534-21rm05:11:511
59502373,6sleep20-21swapper/203:52:052
298332373,7sleep10-21swapper/106:12:261
235132373,6sleep20-21swapper/203:27:382
22322993726,6cyclictest667-21runrttasks01:52:062
22313993726,7cyclictest764-21gzip01:22:111
216022373,6sleep10-21swapper/105:09:321
215832372,6sleep221588-21sh05:09:292
147092372,7sleep214715-21aten_rbpower_cu04:06:502
147092372,7sleep214715-21aten_rbpower_cu04:06:502
87672363,6sleep10-21swapper/101:43:351
325842363,6sleep10-21swapper/104:34:101
2231399364,28cyclictest0-21swapper/103:31:211
2231399364,27cyclictest0-21swapper/104:01:321
22313993624,7cyclictest24950-21ssh04:22:001
22309993624,7cyclictest14066-21grep01:57:200
22309993623,8cyclictest22644-21sort02:21:560
190472362,27sleep119104-21df_inode03:21:581
183182363,6sleep10-21swapper/102:10:351
172192363,6sleep20-21swapper/205:53:112
299582353,6sleep10-21swapper/101:14:051
285232352,28sleep128527-21irqstats02:37:021
276332353,6sleep00-21swapper/002:34:480
258142353,6sleep00-21swapper/002:30:300
2231399353,28cyclictest0-21swapper/102:57:131
22313993524,7cyclictest31424-21uniq03:41:581
22313993523,7cyclictest26572-21ls02:32:001
22313993523,7cyclictest14273-21grep01:57:221
22309993524,6cyclictest19790-21sed02:12:140
2199523511,18sleep00-21swapper/000:55:570
92952342,7sleep19403-21cpu01:46:571
2232299344,26cyclictest0-21swapper/203:36:492
2232299344,25cyclictest0-21swapper/206:04:402
2232299344,25cyclictest0-21swapper/206:04:402
2232299343,28cyclictest0-21swapper/203:26:212
2232299343,27cyclictest0-21swapper/204:38:192
22322993422,7cyclictest27077-21ssh04:26:242
22322993422,7cyclictest17491-21ls05:02:012
22322993422,7cyclictest17491-21ls05:02:012
22322993421,8cyclictest25771-21/usr/sbin/munin05:17:112
22322993421,8cyclictest2135-21grep01:27:022
2231399344,26cyclictest0-21swapper/106:01:241
2231399344,26cyclictest0-21swapper/104:02:021
2231399343,28cyclictest0-21swapper/104:11:311
2231399343,28cyclictest0-21swapper/104:11:311
2231399343,16cyclictest143252rm03:13:011
2231399343,16cyclictest143252rm03:13:011
22313993424,6cyclictest13684-21latency_hist04:56:421
22313993415,14cyclictest28221-21ntpq04:27:041
11692343,6sleep10-21swapper/106:19:391
69702333,6sleep20-21swapper/201:39:292
2232299334,24cyclictest0-21swapper/206:19:212
2232299334,24cyclictest0-21swapper/203:17:062
22322993322,7cyclictest10123-21cut01:47:102
22322993320,8cyclictest21739-21grep04:17:022
22322993315,13cyclictest338-21sort02:47:302
2231399334,26cyclictest0-21swapper/105:22:201
2231399334,25cyclictest0-21swapper/106:02:291
2231399334,25cyclictest0-21swapper/106:02:291
2231399334,25cyclictest0-21swapper/103:09:431
2231399334,24cyclictest0-21swapper/103:46:501
22313993315,13cyclictest31538-21latency_hist02:46:441
2230999333,26cyclictest0-21swapper/002:18:220
22309993321,7cyclictest11471-21cut01:52:000
220962333,6sleep10-21swapper/102:20:531
247812323,6sleep10-21swapper/101:01:501
2232299325,23cyclictest0-21swapper/205:57:142
2232299324,23cyclictest0-21swapper/205:49:322
2232299323,26cyclictest0-21swapper/203:31:452
22322993222,6cyclictest26210-21sendmail_mailst06:07:062
22322993222,6cyclictest26210-21sendmail_mailst06:07:062
22322993222,6cyclictest2352-21ssh03:46:582
22322993222,6cyclictest23234-21missed_timers05:12:032
22322993221,7cyclictest3458-21fschecks_count02:56:562
22322993221,7cyclictest27349-21sed02:32:142
22322993220,7cyclictest667-21runrttasks01:22:122
22322993220,7cyclictest557-21systemd-logind05:26:402
22322993214,14cyclictest25479-21unixbench_singl02:27:152
2231399324,25cyclictest0-21swapper/106:24:151
2231399324,24cyclictest0-21swapper/105:33:481
22313993218,8cyclictest16908-21sshd05:52:191
22313993212,15cyclictest121-17kauditd01:11:461
2232299314,22cyclictest0-21swapper/203:01:542
22322993122,5cyclictest29-21ksoftirqd/201:06:462
22322993121,6cyclictest10274-21grep05:42:102
22322993119,7cyclictest0-21swapper/205:36:402
22322993118,8cyclictest27918-21uptime01:07:182
22322993115,12cyclictest13941-21sh04:56:512
2231399314,23cyclictest0-21swapper/102:51:031
2231399314,22cyclictest0-21swapper/105:42:391
2231399313,25cyclictest0-21swapper/105:19:441
2231399313,25cyclictest0-21swapper/104:43:311
22313993121,6cyclictest2468-21tr01:27:081
22313993120,7cyclictest15905-21ls02:02:131
22313993120,7cyclictest15905-21ls02:02:131
22313993120,6cyclictest2549-21ls05:31:401
22313993120,6cyclictest23134-21grep00:57:011
12682313,6sleep20-21swapper/202:51:522
2232299303,22cyclictest0-21swapper/201:45:502
22322993020,6cyclictest4135-21iostat01:32:032
22322993020,6cyclictest31406-21threads01:17:162
22322993020,6cyclictest29925-21aten_rbpower_en02:41:542
22322993020,6cyclictest28595-21aten_rbpower_po01:11:562
22322993018,7cyclictest557-21systemd-logind02:11:452
22322993018,7cyclictest13971-21sort01:57:192
22322993017,8cyclictest9200-21netstat03:57:072
22322993017,8cyclictest27684-21cut04:26:562
22322993016,8cyclictest15505-21load02:02:052
22322993016,8cyclictest15505-21load02:02:052
2231399304,22cyclictest0-21swapper/105:37:241
2231399304,22cyclictest0-21swapper/103:04:151
22313993021,5cyclictest21-21ksoftirqd/103:37:151
2230999304,21cyclictest0-21swapper/002:41:540
2230999303,23cyclictest0-21swapper/002:47:150
2230999302,21cyclictest17638-21/usr/sbin/munin02:07:110
2232299296,17cyclictest20536-21aten_rbpower_cu02:16:542
2232299295,19cyclictest0-21swapper/202:06:592
22322992919,6cyclictest28432-21aten_rbpower_po06:11:482
22322992919,6cyclictest22859-21if_eth202:21:582
22322992916,8cyclictest557-21systemd-logind03:16:432
22322992916,8cyclictest557-21systemd-logind03:16:432
22322992910,15cyclictest31933-21ls03:42:042
22313992918,6cyclictest12058-21sensors_fan01:52:121
22313992917,7cyclictest24925-21ls02:27:041
2230999294,20cyclictest0-21swapper/001:47:100
22309992918,7cyclictest28593-21grep02:37:030
2232299282,21cyclictest12821-21taskset04:54:012
22322992817,6cyclictest28982-21wc02:37:112
22322992815,8cyclictest2488-21crond05:31:402
22313992816,7cyclictest18838-21/usr/sbin/munin02:11:581
2230999283,18cyclictest0-21swapper/002:51:570
2231399273,18cyclictest22414-21aten_rbpower_cu02:21:531
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional