You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 21:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot4.osadl.org (updated Sun Nov 30, 2025 12:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4321996455,5cyclictest3-21ksoftirqd/002:55:390
432599639,48cyclictest4376-21latency_hist04:15:381
4325996312,45cyclictest6557-21chrt04:17:471
4325996214,41cyclictest6819-21/usr/sbin/munin01:01:101
4325996113,42cyclictest18046-21/usr/sbin/munin01:31:081
4325996111,44cyclictest8700-21/usr/sbin/munin01:06:111
432599609,44cyclictest2431-21seq05:51:551
432599603,51cyclictest28963-21kworker/1:004:09:181
4325996012,42cyclictest12431-21/usr/sbin/munin01:16:091
432599595,48cyclictest0-21swapper/103:20:491
4325995912,12cyclictest4435-21fschecks_count05:55:511
4325995910,42cyclictest3342-21proc_pri02:16:051
4325995910,42cyclictest25552-21/usr/sbin/munin01:50:571
377425913,16sleep20-21swapper/200:51:532
377425913,16sleep20-21swapper/200:51:532
433399584,48cyclictest0-21swapper/203:14:502
4325995814,38cyclictest23669-21/usr/sbin/munin01:46:071
4325995811,41cyclictest18544-21ssh05:29:541
432199585,7cyclictest0-21swapper/006:14:150
432199585,7cyclictest0-21swapper/006:14:150
432199585,46cyclictest0-21swapper/002:56:390
433399575,45cyclictest0-21swapper/205:33:062
432599575,46cyclictest0-21swapper/104:01:081
4325995713,38cyclictest24342-21snmpd04:35:551
4325995713,38cyclictest24342-21snmpd04:35:551
4325995712,38cyclictest11385-21perl03:35:541
4325995711,40cyclictest30646-21sshd02:01:531
4325995710,41cyclictest22900-21ls01:41:111
433799566,43cyclictest23999-21/usr/sbin/munin03:06:003
4337995615,35cyclictest19544-21ssh04:39:353
4337995615,35cyclictest19544-21ssh04:39:353
432599564,46cyclictest0-21swapper/103:04:391
4325995614,36cyclictest16177-21/usr/sbin/munin01:26:031
4325995612,38cyclictest5535-21threads03:26:071
4325995611,39cyclictest27477-21cut01:55:531
4325995611,39cyclictest12619-21ssh04:27:201
4325995611,39cyclictest10329-21ntp_states05:16:001
4325995610,40cyclictest31177-21/usr/sbin/munin02:06:021
432199565,45cyclictest0-21swapper/003:56:520
405125611,16sleep00-21swapper/000:55:170
405125611,16sleep00-21swapper/000:55:170
433399554,7cyclictest0-21swapper/204:36:472
433399554,7cyclictest0-21swapper/204:36:472
4325995514,35cyclictest22729-21df05:35:471
4325995513,36cyclictest8122-21idleruntime06:00:521
4325995513,36cyclictest25561-21ssh03:56:221
4325995512,37cyclictest17897-21ssh06:15:381
4325995512,37cyclictest17897-21ssh06:15:381
4325995512,10cyclictest27782-21sshd05:41:491
4325995511,39cyclictest24342-21snmpd03:00:331
4325995511,38cyclictest20193-21aten_rbpower_cu04:40:481
4325995511,38cyclictest15435-21ssh04:31:351
4325995511,38cyclictest15435-21ssh04:31:351
4325995510,39cyclictest30023-21needreboot04:56:081
4325995510,39cyclictest15059-21grep03:41:021
432599550,8cyclictest6019-21sed05:10:361
432199554,45cyclictest0-21swapper/006:06:480
433399545,42cyclictest0-21swapper/205:00:372
433399544,44cyclictest0-21swapper/204:42:372
432599549,39cyclictest8813-21ssh04:21:061
432599549,39cyclictest12109-21ssh06:06:011
432599549,12cyclictest0-21swapper/103:07:171
432599548,13cyclictest28907-21ssh04:55:181
4325995414,34cyclictest24342-21snmpd02:25:271
4325995413,9cyclictest15106-21iostat_ios06:10:541
4325995413,9cyclictest15106-21iostat_ios06:10:541
4325995412,36cyclictest19420-21tune2fs05:30:511
4325995412,36cyclictest15671-21/usr/sbin/munin02:51:011
4325995411,38cyclictest19217-21ssh03:46:461
4325995410,39cyclictest0-21swapper/105:48:131
4325995410,38cyclictest21548-21sed03:50:591
433799532,45cyclictest23879-21unixbench_singl05:36:063
433799531,47cyclictest26874-21sh05:40:593
433399534,42cyclictest0-21swapper/205:08:262
432599539,38cyclictest19921-21/usr/sbin/munin01:36:061
432599538,40cyclictest7607-21unixbench_singl05:11:091
432599537,40cyclictest0-21swapper/105:22:521
432599537,40cyclictest0-21swapper/105:22:521
432599537,40cyclictest0-21swapper/103:32:041
432599533,45cyclictest0-21swapper/104:46:071
4325995313,34cyclictest8163-21/usr/sbin/munin02:31:051
4325995312,35cyclictest21405-21/usr/sbin/munin06:20:521
4325995311,36cyclictest513-21memory05:00:581
432199534,44cyclictest0-21swapper/005:33:460
433399523,44cyclictest0-21swapper/205:52:252
432599529,38cyclictest956-21wc03:20:391
4325995212,35cyclictest13781-21/usr/sbin/munin02:46:061
4325995212,34cyclictest11907-21/usr/sbin/munin02:41:011
4325995212,34cyclictest11907-21/usr/sbin/munin02:41:011
4325995211,36cyclictest28273-21sed03:11:101
432199524,24cyclictest0-21swapper/006:16:030
432199524,24cyclictest0-21swapper/006:16:030
432199523,43cyclictest0-21swapper/002:21:000
432199522,44cyclictest31109-21ssh04:05:580
4337995110,35cyclictest0-21swapper/302:56:043
433399514,41cyclictest0-21swapper/206:00:052
4325995113,13cyclictest10035-21/usr/sbin/munin02:35:551
4325995113,13cyclictest10035-21/usr/sbin/munin02:35:551
4325995111,34cyclictest14810-21iostat_ios01:21:001
4325995110,10cyclictest10556-21/usr/sbin/munin01:11:081
432199519,37cyclictest13879-21runrttasks05:21:080
432199519,37cyclictest13879-21runrttasks05:21:080
432199514,41cyclictest0-21swapper/005:45:590
432199514,14cyclictest0-21swapper/004:00:500
432199513,43cyclictest0-21swapper/004:49:170
432199513,26cyclictest0-21swapper/003:10:490
433799507,37cyclictest0-21swapper/303:37:243
433399504,20cyclictest0-21swapper/205:47:252
433399503,8cyclictest0-21swapper/205:20:562
433399503,8cyclictest0-21swapper/205:20:562
432199504,41cyclictest0-21swapper/002:00:410
432199504,40cyclictest0-21swapper/003:40:510
432199503,42cyclictest0-21swapper/004:23:470
432199503,41cyclictest0-21swapper/006:01:350
4321995012,32cyclictest0-21swapper/005:06:390
4337994913,30cyclictest15390-21ntp_states06:10:593
4337994913,30cyclictest15390-21ntp_states06:10:593
433399494,40cyclictest0-21swapper/205:41:562
433399494,39cyclictest0-21swapper/206:07:062
433399493,41cyclictest0-21swapper/203:54:582
432199497,36cyclictest30601-21fschecks_count03:15:530
432199495,14cyclictest0-21swapper/004:56:590
432199494,39cyclictest0-21swapper/005:39:220
432199494,39cyclictest0-21swapper/004:35:400
432199494,39cyclictest0-21swapper/004:35:400
432199494,38cyclictest0-21swapper/005:29:420
432199493,8cyclictest0-21swapper/005:00:570
432199493,41cyclictest0-21swapper/004:52:070
432199493,41cyclictest0-21swapper/001:36:220
432199493,40cyclictest0-21swapper/004:18:380
4321994919,24cyclictest3-21ksoftirqd/004:31:270
4321994919,24cyclictest3-21ksoftirqd/004:31:270
4321994911,32cyclictest0-21swapper/003:49:560
4337994813,29cyclictest1003-21/usr/sbin/munin05:01:073
4337994810,33cyclictest0-21swapper/305:46:443
433799481,42cyclictest28604-21unixbench_multi04:01:093
433399483,40cyclictest0-21swapper/203:59:582
433399483,40cyclictest0-21swapper/203:01:192
433399483,39cyclictest0-21swapper/203:25:372
4333994811,5cyclictest0-21swapper/206:15:292
4333994811,5cyclictest0-21swapper/206:15:292
4333994811,31cyclictest0-21swapper/203:07:222
4325994810,33cyclictest7875-21sshd02:29:531
432199485,36cyclictest0-21swapper/004:45:100
432199484,38cyclictest0-21swapper/005:52:410
432199484,38cyclictest0-21swapper/001:26:010
432199484,20cyclictest0-21swapper/006:24:110
432199483,9cyclictest0-21swapper/004:27:370
432199483,40cyclictest0-21swapper/003:00:400
432199483,38cyclictest0-21swapper/003:32:550
4321994810,5cyclictest0-21swapper/003:29:560
433799476,36cyclictest4622-21/usr/sbin/munin04:16:023
433799475,36cyclictest0-21swapper/303:31:243
433799474,38cyclictest20233-21/usr/sbin/munin05:31:063
433799474,37cyclictest0-21swapper/305:27:453
433399475,36cyclictest0-21swapper/205:26:482
433399474,38cyclictest0-21swapper/202:57:352
433399474,37cyclictest0-21swapper/203:26:322
433399473,8cyclictest0-21swapper/200:56:322
433399473,8cyclictest0-21swapper/200:56:322
433399473,39cyclictest0-21swapper/203:18:592
433399472,39cyclictest23205-21kworker/2:104:15:082
4325994710,12cyclictest24342-21snmpd00:57:371
4325994710,12cyclictest24342-21snmpd00:57:371
432199475,6cyclictest0-21swapper/001:45:410
432199475,36cyclictest0-21swapper/003:37:430
432199474,37cyclictest0-21swapper/005:17:110
432199474,37cyclictest0-21swapper/003:21:150
432199473,39cyclictest0-21swapper/005:40:420
432199473,39cyclictest0-21swapper/005:12:060
4321994711,31cyclictest0-21swapper/003:55:310
433799463,37cyclictest8604-21ssh05:13:503
4337994613,8cyclictest5486-21latency00:56:013
4337994613,8cyclictest5486-21latency00:56:013
433399467,33cyclictest0-21swapper/205:37:042
433399464,36cyclictest0-21swapper/204:21:132
433399464,36cyclictest0-21swapper/204:15:442
433399464,36cyclictest0-21swapper/204:04:422
433399464,36cyclictest0-21swapper/203:33:322
433399464,15cyclictest0-21swapper/204:08:052
433399463,7cyclictest0-21swapper/206:23:552
433399462,38cyclictest588-21irqbalance03:46:382
432199464,36cyclictest0-21swapper/004:11:260
432199463,36cyclictest0-21swapper/001:50:410
432199462,38cyclictest12281-21latency_hist01:15:410
4321994618,23cyclictest0-21swapper/005:56:160
433799455,9cyclictest0-21swapper/303:51:123
433399457,32cyclictest0-21swapper/204:26:082
433399456,33cyclictest0-21swapper/204:52:282
433399454,35cyclictest0-21swapper/206:04:532
433399454,35cyclictest0-21swapper/205:02:272
432599453,7cyclictest0-21swapper/102:12:401
432199455,6cyclictest0-21swapper/001:00:420
432199455,6cyclictest0-21swapper/001:00:420
432199454,36cyclictest0-21swapper/002:11:050
432199454,35cyclictest25376-21sshd03:06:110
432199453,37cyclictest0-21swapper/002:42:520
432199453,37cyclictest0-21swapper/002:42:520
432199452,37cyclictest8455-21crond01:05:410
433799443,36cyclictest0-21swapper/303:14:593
433399448,31cyclictest0-21swapper/203:37:122
433399448,30cyclictest0-21swapper/205:10:452
433399447,32cyclictest0-21swapper/206:15:492
433399447,32cyclictest0-21swapper/206:15:492
433399445,33cyclictest0-21swapper/205:19:532
433399445,33cyclictest0-21swapper/204:48:362
433399445,33cyclictest0-21swapper/203:42:372
432199444,8cyclictest0-21swapper/002:05:580
432199444,6cyclictest0-21swapper/002:30:400
432199444,5cyclictest0-21swapper/001:10:420
432199443,9cyclictest0-21swapper/001:30:540
432199443,36cyclictest0-21swapper/002:19:230
432199443,36cyclictest0-21swapper/001:53:530
40222448,12sleep10-21swapper/100:54:541
40222448,12sleep10-21swapper/100:54:541
433399438,29cyclictest0-21swapper/202:25:582
433399433,6cyclictest0-21swapper/202:25:412
432199434,34cyclictest0-21swapper/001:22:490
432199433,35cyclictest0-21swapper/002:46:200
432199432,34cyclictest9862-21latency_hist02:35:400
432199423,35cyclictest0-21swapper/002:02:590
433399413,34cyclictest0-21swapper/202:50:402
432199413,33cyclictest0-21swapper/002:40:020
432199413,33cyclictest0-21swapper/002:40:020
432199413,32cyclictest0-21swapper/001:20:420
4333994027,8cyclictest12779-21tune2fs01:15:572
19522403,10sleep20-21swapper/202:11:162
433799394,23cyclictest8342cpu05:50:493
433399393,32cyclictest0-21swapper/202:43:272
433399393,32cyclictest0-21swapper/202:43:272
27342399,20sleep30-21swapper/300:50:583
27342399,20sleep30-21swapper/300:50:583
95352373,6sleep20-21swapper/202:32:172
4337993724,8cyclictest23982-21tune2fs01:45:563
270032373,6sleep20-21swapper/201:53:132
433799367,23cyclictest74450ssh03:20:163
4337993625,7cyclictest4162-21/usr/sbin/munin05:55:593
4337993624,8cyclictest15487-21grep01:21:133
4337993624,7cyclictest8454-21crond01:05:413
4337993620,11cyclictest9175-21runrttasks04:21:113
4337993618,13cyclictest21405-21/usr/sbin/munin06:20:583
4337993617,14cyclictest11119-21/usr/sbin/munin06:05:573
4337993616,15cyclictest667-21runrttasks03:41:123
433799356,23cyclictest32070-21ssh04:06:323
433799353,28cyclictest0-21swapper/302:12:453
433799353,27cyclictest0-21swapper/303:47:043
4337993524,7cyclictest5775-21grep03:26:093
433799348,20cyclictest19972-21wget01:35:533
4337993422,7cyclictest4032-21cat05:06:063
4337993410,19cyclictest14983-21switchtime04:31:073
4337993410,19cyclictest14983-21switchtime04:31:073
4333993423,7cyclictest15205-21seq04:31:102
4333993423,7cyclictest15205-21seq04:31:102
433799335,23cyclictest0-21swapper/306:04:283
4337993320,8cyclictest16423-21awk02:51:023
4337993319,9cyclictest0-21swapper/304:26:133
4337993315,12cyclictest26325-21chrt01:51:043
4337993314,14cyclictest20856-21/usr/sbin/munin04:40:593
4333993323,6cyclictest15948-21latency_hist01:25:422
4333993320,8cyclictest378-21systemd-journal02:46:092
195632333,6sleep20-21swapper/201:34:062
433799324,22cyclictest0-21swapper/304:10:583
4337993221,7cyclictest13973-21grep02:45:533
4337993220,8cyclictest8708-21cat02:30:593
4337993220,7cyclictest28416-21cat01:56:093
4337993218,9cyclictest6320-21aten_rbpower_en02:25:523
4337993216,11cyclictest21831-21awk03:01:133
4337993216,10cyclictest0-21swapper/302:10:403
4337993215,12cyclictest667-21runrttasks02:37:183
4337993215,12cyclictest667-21runrttasks02:37:183
4337993214,13cyclictest22359-21latency01:41:003
433799320,26cyclictest3115950ssh04:57:393
4333993220,8cyclictest7681-21gzip01:01:082
433799314,22cyclictest0-21swapper/305:23:153
433799314,22cyclictest0-21swapper/305:23:153
433799314,22cyclictest0-21swapper/303:57:303
4337993120,7cyclictest1614-21ls03:20:543
4337993120,7cyclictest12699-21tune2fs01:15:563
4337993120,6cyclictest16947-21ntp_states01:26:073
4337993119,7cyclictest9051-21cut01:06:013
4337993118,7cyclictest18558-21/usr/sbin/munin06:15:563
4337993118,7cyclictest18558-21/usr/sbin/munin06:15:563
4337993117,8cyclictest19561-21taskset01:34:033
4337993116,10cyclictest27409-21grep04:51:123
4337993113,13cyclictest3022-21interrupts02:15:573
4337993111,14cyclictest9887-21fschecks_time05:15:523
433399314,21cyclictest0-21swapper/201:40:552
4333993121,6cyclictest9728-21wc01:06:152
4337993014,11cyclictest30102-21open_inodes02:01:083
4337993014,10cyclictest0-21swapper/304:45:503
4337993013,12cyclictest12272-21fschecks_time02:40:563
4337993013,12cyclictest12272-21fschecks_time02:40:563
4337993013,11cyclictest0-21swapper/302:21:013
4337993012,13cyclictest667-21runrttasks01:14:383
433399304,22cyclictest0-21swapper/201:36:162
433399304,21cyclictest0-21swapper/202:35:502
433399304,21cyclictest0-21swapper/202:35:502
4333993022,4cyclictest0-21swapper/201:26:032
4333992917,7cyclictest28627-21grep01:56:122
4333992915,10cyclictest667-21runrttasks02:20:342
433399285,17cyclictest0-21swapper/202:06:082
433399284,20cyclictest0-21swapper/201:45:542
4333992818,6cyclictest29312-21/usr/sbin/munin02:01:032
4333992717,6cyclictest667-21runrttasks01:10:442
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional