You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-16 - 00:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot4.osadl.org (updated Tue Jul 15, 2025 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2424199712,36cyclictest10290-21ssh06:00:303
24241997111,55cyclictest0-21swapper/306:18:153
2424199704,60cyclictest13227-21/usr/sbin/munin05:15:003
2424199703,61cyclictest7397-21/usr/sbin/munin02:50:223
2424199702,62cyclictest9269-21/usr/sbin/munin02:55:133
2424199702,62cyclictest22508-21/usr/sbin/munin05:30:133
2424199702,62cyclictest14895-21/usr/sbin/munin03:10:173
2424199702,33cyclictest26703-21/usr/sbin/munin02:15:223
24241997011,53cyclictest0-21swapper/305:28:363
2424199693,59cyclictest29687-21/usr/sbin/munin05:40:113
2424199692,60cyclictest24247-21/usr/sbin/munin03:35:163
2424199692,29cyclictest667-21runrttasks05:24:443
24241996912,51cyclictest0-21swapper/304:29:243
24241996910,53cyclictest0-21swapper/307:26:173
24241996910,53cyclictest0-21swapper/306:12:213
2424199688,54cyclictest0-21swapper/305:46:123
2424199682,61cyclictest28572-21/usr/sbin/munin02:20:003
2424199682,60cyclictest22374-21/usr/sbin/munin03:30:133
24241996811,51cyclictest0-21swapper/304:56:493
24241996811,51cyclictest0-21swapper/304:56:493
24241996811,24cyclictest0-21swapper/305:56:573
24241996811,24cyclictest0-21swapper/305:56:573
2424199677,54cyclictest0-21swapper/306:40:513
2424199673,58cyclictest9206-21df_inode06:50:013
2424199673,58cyclictest8323-21/usr/sbin/munin07:34:593
2424199673,58cyclictest8323-21/usr/sbin/munin07:34:593
2424199673,58cyclictest29043-21ssh07:19:123
2424199673,57cyclictest32505-21/usr/sbin/munin06:35:123
2424199673,57cyclictest295412sleep306:30:313
2424199672,60cyclictest13749-21taskset06:06:163
2424199672,59cyclictest3092-21/usr/sbin/munin04:05:023
2424199672,59cyclictest26122-21/usr/sbin/munin03:40:133
2424199672,59cyclictest18636-21/usr/sbin/munin03:20:113
2424199672,59cyclictest1788-21/usr/sbin/munin02:35:163
2424199672,58cyclictest20507-21/usr/sbin/munin03:25:103
24241996711,50cyclictest0-21swapper/307:14:163
2424199664,56cyclictest24707-21/usr/sbin/munin06:25:113
2424199663,57cyclictest10011-21ssh05:09:543
2424199663,29cyclictest29950-21ssh04:49:473
2424199662,58cyclictest6495-21cat02:45:173
2424199662,58cyclictest27987-21/usr/sbin/munin03:45:133
2424199662,31cyclictest31726-21/usr/sbin/munin03:55:113
2424199655,27cyclictest0-21swapper/307:34:193
2424199654,55cyclictest0-21swapper/306:58:123
2424199654,55cyclictest0-21swapper/306:48:293
2424199654,55cyclictest0-21swapper/306:48:293
2424199654,55cyclictest0-21swapper/304:33:413
2424199654,55cyclictest0-21swapper/304:17:163
2424199653,55cyclictest5850-21ntp_states04:10:083
2424199652,57cyclictest32309-21/usr/sbin/munin02:30:153
2424199652,57cyclictest31781-21ssh07:22:203
2424199652,57cyclictest30439-21/usr/sbin/munin02:25:153
2424199652,57cyclictest22992-21ssh06:20:413
2424199652,57cyclictest16762-21/usr/sbin/munin03:15:023
2424199644,54cyclictest0-21swapper/307:06:273
2424199644,54cyclictest0-21swapper/307:03:593
2424199644,54cyclictest0-21swapper/305:04:013
2424199644,54cyclictest0-21swapper/304:21:593
2424199643,55cyclictest4634-21ssh05:52:013
2424199643,55cyclictest28009-21ssh05:38:303
2424199642,56cyclictest26823-21/usr/sbin/munin04:45:203
2424199642,56cyclictest11382-21cut03:00:033
2424199642,55cyclictest8255-21ssh05:05:183
2424199642,55cyclictest22948-21ssh04:37:563
2424199632,54cyclictest3657-21/usr/sbin/munin02:40:033
2424199632,54cyclictest29963-21wget03:49:583
24241996310,24cyclictest0-21swapper/304:43:223
2424199622,54cyclictest26482-21munin-run02:14:473
2424199622,54cyclictest26482-21munin-run02:14:473
2424199602,30cyclictest2828-21sshd04:04:173
2424199554,46cyclictest0-21swapper/303:08:103
2422599556,43cyclictest18241-21sshd05:22:161
24225995412,37cyclictest0-21swapper/106:44:541
24225995412,37cyclictest0-21swapper/106:44:541
2422599535,41cyclictest23660-21wc07:10:141
24225995313,34cyclictest12071-21ssh05:12:301
2422599525,41cyclictest378-21systemd-journal04:51:171
2422199527,39cyclictest0-21swapper/005:28:130
2422199524,42cyclictest0-21swapper/006:43:140
2422199524,42cyclictest0-21swapper/004:42:090
2422199524,24cyclictest0-21swapper/007:26:050
24221995219,28cyclictest0-21swapper/005:45:020
2422199521,5cyclictest3408-21munin-plugin-st04:59:440
2422199521,5cyclictest3408-21munin-plugin-st04:59:440
2423499514,40cyclictest0-21swapper/207:23:312
2422599519,36cyclictest26801-21/usr/sbin/munin07:15:051
24225995110,35cyclictest0-21swapper/105:45:331
2422199514,7cyclictest0-21swapper/007:14:310
2423499509,35cyclictest0-21swapper/205:00:172
2423499504,20cyclictest0-21swapper/205:25:152
2422599509,35cyclictest15702-21/usr/sbin/munin07:00:011
2422599506,38cyclictest10085-21ssh06:00:141
2422599503,41cyclictest0-21swapper/104:25:051
24225995010,34cyclictest0-21swapper/105:56:011
24225995010,34cyclictest0-21swapper/105:56:011
2422199504,40cyclictest0-21swapper/006:46:140
2422199504,40cyclictest0-21swapper/006:46:140
2422199504,40cyclictest0-21swapper/004:00:190
2422199504,22cyclictest0-21swapper/007:04:270
2422199503,41cyclictest0-21swapper/005:04:520
24221995011,6cyclictest9223-21forks06:50:020
2422599499,34cyclictest0-21swapper/107:31:381
2422599499,34cyclictest0-21swapper/106:29:231
2422599496,36cyclictest3118-21ssh06:40:051
2422599494,39cyclictest24834-21/usr/sbin/munin02:10:031
2422599494,39cyclictest24834-21/usr/sbin/munin02:10:031
2422599493,41cyclictest0-21swapper/104:57:041
2422599493,41cyclictest0-21swapper/104:57:041
24225994913,31cyclictest0-21swapper/107:37:271
24225994913,31cyclictest0-21swapper/107:37:271
24225994913,30cyclictest0-21swapper/106:05:061
24225994912,31cyclictest0-21swapper/104:29:531
24225994910,33cyclictest1-21systemd06:17:151
24225994910,33cyclictest0-21swapper/105:41:181
2422199494,8cyclictest0-21swapper/006:31:220
2422199494,39cyclictest0-21swapper/005:57:260
2422199494,39cyclictest0-21swapper/005:57:260
2422199493,8cyclictest588-21irqbalance05:39:430
2422199493,41cyclictest0-21swapper/006:58:510
2422199493,40cyclictest0-21swapper/006:20:120
2423499488,34cyclictest0-21swapper/204:40:312
2423499484,38cyclictest0-21swapper/204:45:132
2422599484,38cyclictest0-21swapper/105:35:391
2422599484,38cyclictest0-21swapper/104:36:071
2422599484,38cyclictest0-21swapper/104:17:121
2422599483,40cyclictest0-21swapper/106:13:321
24225994814,29cyclictest31599-21df_inode06:34:561
24225994813,7cyclictest14000-21ssh05:15:131
24225994813,30cyclictest0-21swapper/107:25:061
2422199486,36cyclictest0-21swapper/004:14:440
2422199485,37cyclictest0-21swapper/004:46:430
2422199485,13cyclictest0-21swapper/007:22:300
2422199484,38cyclictest0-21swapper/005:19:320
2422199483,40cyclictest0-21swapper/005:31:230
2422199483,39cyclictest29155-21ssh05:40:000
2422199483,39cyclictest0-21swapper/007:16:410
2422199483,22cyclictest0-21swapper/004:32:200
2422199482,40cyclictest22164-21kworker/0:004:38:270
24221994812,5cyclictest0-21swapper/005:54:090
2423499478,33cyclictest0-21swapper/205:32:022
2423499475,35cyclictest0-21swapper/205:53:482
2423499474,36cyclictest0-21swapper/204:29:252
2422599479,33cyclictest0-21swapper/106:23:351
2422599479,32cyclictest0-21swapper/105:26:011
2422599478,34cyclictest0-21swapper/107:19:461
2422599478,33cyclictest8942-21kworker/1:004:49:221
2422599475,37cyclictest5028-21/usr/sbin/munin04:10:161
2422599473,39cyclictest0-21swapper/104:20:111
24225994710,32cyclictest0-21swapper/106:29:451
24221994710,31cyclictest0-21swapper/005:22:480
2423499465,35cyclictest0-21swapper/206:41:202
2423499463,37cyclictest0-21swapper/207:30:112
2422599465,7cyclictest0-21swapper/105:05:131
2422599465,36cyclictest0-21swapper/107:05:171
2422599463,8cyclictest0-21swapper/106:55:311
2422599463,37cyclictest0-21swapper/105:34:391
2422199464,37cyclictest0-21swapper/004:24:560
2422199464,37cyclictest0-21swapper/003:05:150
2422199464,36cyclictest0-21swapper/007:36:270
2422199464,36cyclictest0-21swapper/007:36:270
2422199464,36cyclictest0-21swapper/005:12:520
2422199464,36cyclictest0-21swapper/004:51:590
2422199464,36cyclictest0-21swapper/004:19:300
2422199463,7cyclictest0-21swapper/004:19:550
2422199462,38cyclictest19816-21ssh06:15:260
24221994615,6cyclictest32254-21ntpq06:35:080
2423499458,5cyclictest0-21swapper/204:38:462
2423499455,35cyclictest0-21swapper/207:10:542
2423499455,34cyclictest0-21swapper/205:55:412
2423499455,34cyclictest0-21swapper/205:55:412
2423499455,34cyclictest0-21swapper/205:36:402
2423499455,34cyclictest0-21swapper/205:10:322
2423499453,37cyclictest0-21swapper/206:55:022
24234994511,28cyclictest7669-21/usr/sbin/munin07:35:022
24234994511,28cyclictest7669-21/usr/sbin/munin07:35:022
2422599457,32cyclictest0-21swapper/104:40:531
2422599454,36cyclictest0-21swapper/105:50:131
24225994511,29cyclictest10467-21ssh06:50:301
2422199454,36cyclictest0-21swapper/006:14:090
2422199454,35cyclictest0-21swapper/007:06:370
24221994536,5cyclictest3-21ksoftirqd/002:19:470
2422199453,37cyclictest0-21swapper/006:04:540
2422199453,37cyclictest0-21swapper/002:10:100
2422199453,37cyclictest0-21swapper/002:10:100
2422199453,36cyclictest0-21swapper/007:31:060
2423499445,7cyclictest0-21swapper/205:06:582
2422599444,34cyclictest5536-21ssh05:01:401
2422599443,36cyclictest0-21swapper/103:34:061
2422199445,33cyclictest0-21swapper/005:01:200
2422199444,35cyclictest0-21swapper/006:26:360
2422199443,37cyclictest0-21swapper/006:02:120
2423499433,35cyclictest0-21swapper/205:15:442
183682433,7sleep20-21swapper/206:14:492
24221994233,5cyclictest3-21ksoftirqd/003:49:450
24221994233,5cyclictest3-21ksoftirqd/002:59:460
2422199423,12cyclictest0-21swapper/003:21:330
85572413,8sleep20-21swapper/206:49:182
85572413,8sleep20-21swapper/206:49:182
2423499419,26cyclictest784-21sh06:36:142
24221994128,10cyclictest0-21swapper/003:03:470
192732413,7sleep20-21swapper/204:31:382
315862383,7sleep20-21swapper/204:50:582
2422199384,28cyclictest0-21swapper/003:58:570
88402373,7sleep20-21swapper/202:52:232
49772373,7sleep20-21swapper/202:40:522
46012373,8sleep20-21swapper/204:08:122
26642373,7sleep20-21swapper/204:02:202
2423499373,28cyclictest0-21swapper/206:13:372
24234993726,7cyclictest8849-21/usr/sbin/munin06:00:082
24225993725,7cyclictest30926-21ls03:50:151
24221993728,5cyclictest3-21ksoftirqd/004:09:440
2389323712,19sleep10-21swapper/102:08:401
2389323712,19sleep10-21swapper/102:08:401
2380023713,18sleep00-21swapper/002:07:350
2380023713,18sleep00-21swapper/002:07:350
227462379,19sleep30-21swapper/302:05:053
227462379,19sleep30-21swapper/302:05:053
219282373,7sleep20-21swapper/203:27:122
20892373,7sleep20-21swapper/204:55:332
20892373,7sleep20-21swapper/204:55:332
2423499364,27cyclictest0-21swapper/206:27:342
24234993611,18cyclictest15702-21/usr/sbin/munin07:00:022
24225993624,7cyclictest1944-21awk04:00:091
24225993614,17cyclictest0-21swapper/102:40:061
236062364,8sleep20-21swapper/202:05:202
236062364,8sleep20-21swapper/202:05:202
183172363,5sleep20-21swapper/205:22:292
105512363,7sleep20-21swapper/202:55:292
87602353,6sleep00-21swapper/002:51:240
2423499353,28cyclictest0-21swapper/206:21:342
2423499353,27cyclictest0-21swapper/202:15:072
24234993525,6cyclictest1960-21grep07:25:122
2423499351,29cyclictest28517-21sort06:29:592
2422599353,28cyclictest0-21swapper/102:33:501
2422599353,27cyclictest0-21swapper/102:25:051
24225993524,7cyclictest21432-21cat03:25:161
24225993523,7cyclictest26228-21wget03:39:591
24221993524,7cyclictest5892-21sort02:45:040
318362343,6sleep00-21swapper/002:26:500
296892343,5sleep20-21swapper/205:40:122
2423499344,26cyclictest0-21swapper/202:14:072
2423499344,26cyclictest0-21swapper/202:14:072
24234993423,6cyclictest28624-21wget02:19:592
24225993411,17cyclictest29699-21unixbench-2d02:20:181
274862333,7sleep20-21swapper/203:41:282
2422599334,24cyclictest6343-21wc02:45:141
24225993322,7cyclictest13763-21tr03:05:131
24225993315,12cyclictest0-21swapper/103:47:341
24225993314,14cyclictest0-21swapper/103:10:081
24221993311,18cyclictest3-21ksoftirqd/003:50:090
2422199331,28cyclictest3435-21crond02:39:460
24225993222,6cyclictest18753-21wc03:20:001
24225993221,7cyclictest10492-21grep02:55:191
24225993217,9cyclictest0-21swapper/103:55:041
24225993215,12cyclictest667-21runrttasks03:02:301
24225993210,17cyclictest0-21swapper/104:05:021
24221993215,12cyclictest17542-21open_files03:15:130
14082323,7sleep20-21swapper/202:32:562
2423499315,22cyclictest281ktimersoftd/203:10:172
2423499314,22cyclictest0-21swapper/206:04:572
2423499313,24cyclictest0-21swapper/202:45:062
24234993117,10cyclictest0-21swapper/204:23:202
2422599313,23cyclictest0-21swapper/102:49:551
24225993119,7cyclictest17075-21cut03:15:001
24225993117,9cyclictest0-21swapper/103:38:321
24225993116,10cyclictest0-21swapper/102:15:211
24225993114,11cyclictest0-21swapper/102:34:591
2423499304,22cyclictest0-21swapper/206:50:162
24234993020,6cyclictest8892-21ntp_offset04:15:072
24234993018,7cyclictest26130-21cpu07:14:542
24234993018,7cyclictest11707-21wc03:00:072
2422199303,22cyclictest26478-21perl03:40:020
2422199303,22cyclictest0-21swapper/003:33:120
2422199303,22cyclictest0-21swapper/003:25:000
24221993021,5cyclictest3-21ksoftirqd/003:14:460
24221993019,7cyclictest24599-21tune2fs03:35:060
2423499294,20cyclictest0-21swapper/204:09:512
2423499294,20cyclictest0-21swapper/203:16:582
24234992920,5cyclictest25899-21latency_hist03:39:462
24234992917,8cyclictest30825-21grep02:25:052
24234992818,6cyclictest19510-21idleruntime07:04:572
24234992816,7cyclictest2393-21crond05:49:432
24234992816,7cyclictest13449-21idleruntime03:05:072
24234992815,8cyclictest557-21systemd-logind03:44:462
24234992814,9cyclictest598-21gdbus03:54:462
2422199283,20cyclictest0-21swapper/002:30:150
24221992816,7cyclictest3805-21cpu02:39:580
24234992718,5cyclictest30008-21cpu03:49:582
24234992717,6cyclictest667-21runrttasks03:20:072
24234992717,6cyclictest2153-21fschecks_time02:35:022
2422199274,18cyclictest29066-21/usr/sbin/munin02:20:060
24234992616,6cyclictest22849-21if_eth203:30:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional