You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 15:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Dec 23, 2025 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6567212212,79sleep26585-21/usr/sbin/munin07:05:052
8057991076,82cyclictest22052-21apt-get07:50:081
721021059,66sleep07252-21/usr/sbin/munin07:05:360
80579910144,50cyclictest30605-21kworker/u18:0+nfsiod10:18:261
80529910176,19cyclictest574-21sendmail12:19:540
8052999971,18cyclictest32543-21latency_hist11:24:580
807099982,66cyclictest10702-21taskset09:55:363
806299976,78cyclictest22052-21apt-get07:50:142
676429722,37sleep10-21swapper/107:05:211
8057999546,38cyclictest0-21swapper/109:35:331
8057999545,41cyclictest0-21swapper/111:25:301
8052999360,8cyclictest181rcu_preempt11:15:210
8052999258,11cyclictest181rcu_preempt10:05:070
8052999142,16cyclictest181rcu_preempt10:10:180
8052999142,16cyclictest181rcu_preempt10:10:180
8062998976,9cyclictest8047-21cyclictest11:49:562
8062998866,15cyclictest21098-21unixbench_multi07:45:312
805799884,73cyclictest0-21swapper/108:00:081
805799883,80cyclictest0-21swapper/110:20:081
805799883,80cyclictest0-21swapper/110:20:081
8052998866,15cyclictest17754-21ssh11:54:200
8052998846,31cyclictest0-21swapper/011:35:150
8052998833,39cyclictest5687-21kernelversion10:40:190
8062998764,16cyclictest30316-21sh11:20:282
805799874,75cyclictest0-21swapper/107:10:131
8052998753,29cyclictest0-21swapper/012:09:580
8052998753,29cyclictest0-21swapper/012:09:580
805799862,74cyclictest0-21swapper/108:45:071
805799862,74cyclictest0-21swapper/108:45:071
8062998562,17cyclictest363-21snmpd12:25:302
805799854,76cyclictest0-21swapper/111:10:061
805799854,76cyclictest0-21swapper/111:10:061
805799854,74cyclictest0-21swapper/107:20:451
805799854,74cyclictest0-21swapper/107:20:451
805799853,73cyclictest0-21swapper/109:00:111
8052998565,14cyclictest7305-21latency_hist08:44:570
8052998565,14cyclictest7305-21latency_hist08:44:570
8052998553,12cyclictest181rcu_preempt08:50:110
8052998553,12cyclictest181rcu_preempt08:50:110
8052998549,11cyclictest0-21swapper/010:55:330
8062998461,17cyclictest1277-21sh10:33:102
806299842,65cyclictest16988-21kworker/u17:3+flush-179:809:55:242
805799843,72cyclictest0-21swapper/108:10:061
805799843,71cyclictest0-21swapper/111:55:081
805799843,71cyclictest0-21swapper/111:55:081
805799835,73cyclictest0-21swapper/112:00:091
805799833,74cyclictest0-21swapper/108:40:091
805799833,74cyclictest0-21swapper/108:40:091
8057998331,44cyclictest0-21swapper/111:05:221
8062998260,16cyclictest382-21rs:main2
8062998260,16cyclictest382-21rs:main2
8062998257,19cyclictest3065-21latency_hist11:29:572
8062998250,20cyclictest15203-21diskmemload11:39:572
806299823,41cyclictest11626-21apt-get07:20:082
806299823,41cyclictest11626-21apt-get07:20:082
8057998258,15cyclictest201-21systemd-journal09:56:001
805799823,73cyclictest0-21swapper/108:05:061
805799822,75cyclictest0-21swapper/111:45:061
8052998267,11cyclictest8047-21cyclictest11:04:550
8052998253,20cyclictest15203-21diskmemload11:25:310
805299824,68cyclictest10510-21apt-get09:55:290
8062998161,11cyclictest5878-21sh10:40:242
805799814,65cyclictest0-21swapper/107:40:081
8057998143,33cyclictest30990-21proc_pri12:15:271
8057998141,33cyclictest22448-21timerandwakeup09:20:291
8057998141,33cyclictest22448-21timerandwakeup09:20:291
805799813,73cyclictest0-21swapper/107:45:101
805799813,68cyclictest0-21swapper/109:10:061
8062998057,16cyclictest346-21runrttasks09:05:302
8057998043,32cyclictest8047-21cyclictest10:59:301
805799803,71cyclictest0-21swapper/108:55:101
805799802,73cyclictest0-21swapper/108:20:111
805799802,73cyclictest0-21swapper/108:20:111
8052998056,18cyclictest60-21kcompactd008:31:080
8052998056,18cyclictest60-21kcompactd008:31:080
8052998048,23cyclictest24519-21chrt07:55:300
8052998048,10cyclictest181rcu_preempt10:30:330
8052998041,10cyclictest181rcu_preempt12:10:080
805299803,38cyclictest15841-21fschecks_time09:10:170
805799794,69cyclictest0-21swapper/107:30:111
805799794,65cyclictest0-21swapper/111:30:101
805799794,65cyclictest0-21swapper/111:30:101
8057997939,32cyclictest0-21swapper/109:50:281
8057997939,32cyclictest0-21swapper/109:50:281
8057997937,35cyclictest0-21swapper/112:25:241
805799792,72cyclictest0-21swapper/112:30:081
805799792,72cyclictest0-21swapper/112:30:081
8052997962,11cyclictest1907-21proc_pri09:40:260
8052997962,11cyclictest1907-21proc_pri09:40:260
805299793,61cyclictest7664-21cat12:30:290
805299793,61cyclictest7664-21cat12:30:290
8062997855,13cyclictest369-21sshd11:01:132
8062997845,16cyclictest181rcu_preempt08:50:212
8062997845,16cyclictest181rcu_preempt08:50:212
8057997853,19cyclictest11866-21sh10:50:241
805799783,68cyclictest0-21swapper/109:15:041
805799783,68cyclictest0-21swapper/109:15:041
8057997831,40cyclictest0-21swapper/112:20:081
8057997831,39cyclictest0-21swapper/107:19:581
8052997862,10cyclictest25033-21rm09:25:210
8052997861,10cyclictest201-21systemd-journal08:23:100
8052997861,10cyclictest201-21systemd-journal08:23:100
8052997856,17cyclictest363-21snmpd12:00:300
8052997854,15cyclictest31303-21ssh10:29:500
805299784,37cyclictest11187-21latency_hist10:49:570
8062997762,11cyclictest8047-21cyclictest11:15:562
805799774,46cyclictest26972-21ssh11:15:371
805799773,69cyclictest0-21swapper/111:40:101
805799773,68cyclictest0-21swapper/109:25:071
805799773,67cyclictest0-21swapper/108:25:111
805799773,67cyclictest0-21swapper/108:25:111
805799772,70cyclictest0-21swapper/112:10:071
8052997754,17cyclictest1218-21fschecks_time12:20:150
8052997753,15cyclictest30960-21kworker/u18:0-events_unbound10:39:550
8052997745,22cyclictest0-21swapper/009:45:140
8052997742,28cyclictest27365-21ssh10:22:140
8052997742,28cyclictest27365-21ssh10:22:140
8052997742,27cyclictest0-21swapper/011:45:270
8052997742,12cyclictest181rcu_preempt07:19:580
805299773,42cyclictest10524-21ntp_states12:35:240
8062997653,17cyclictest11819-21latency_hist07:19:572
8062997650,17cyclictest2389-21sh12:21:342
805799764,67cyclictest0-21swapper/110:30:051
8057997637,31cyclictest0-21swapper/112:05:161
8057997637,31cyclictest0-21swapper/112:05:161
805799763,68cyclictest0-21swapper/111:35:121
805799763,68cyclictest0-21swapper/108:30:101
805799763,68cyclictest0-21swapper/108:30:101
8057997634,35cyclictest0-21swapper/112:35:121
8057997630,38cyclictest0-21swapper/110:08:301
8052997628,30cyclictest28463-21switchtime09:30:310
8052997613,33cyclictest6823-21latency_hist12:29:570
805799754,66cyclictest0-21swapper/110:35:081
805799754,66cyclictest0-21swapper/109:05:111
8057997532,36cyclictest0-21swapper/107:35:161
8057997530,40cyclictest0-21swapper/108:15:281
8057997530,40cyclictest0-21swapper/108:15:281
8057997528,39cyclictest0-21swapper/110:25:221
8052997560,10cyclictest15203-21diskmemload09:51:210
8052997560,10cyclictest15203-21diskmemload09:51:210
8052997552,17cyclictest12191-21latency_hist11:44:580
8052997551,17cyclictest0-21swapper/007:20:490
8052997551,17cyclictest0-21swapper/007:20:490
8052997551,13cyclictest0-21swapper/010:15:110
8062997454,14cyclictest28027-21processes12:10:272
806299744,45cyclictest13577-21latency_hist09:04:572
806299743,48cyclictest4898-21grep08:35:292
806299743,48cyclictest4898-21grep08:35:292
806299743,34cyclictest10301-21sed11:40:322
8057997457,11cyclictest382-21rs:main1
8057997457,11cyclictest382-21rs:main1
8057997429,41cyclictest30960-21kworker/u18:0+nfsiod11:00:151
805799742,67cyclictest0-21swapper/110:00:101
8057997415,51cyclictest14546-21cat07:25:281
805299747,37cyclictest12430-21unixbench_singl10:50:350
8052997445,20cyclictest3267-21sh11:30:110
8052997445,20cyclictest3267-21sh11:30:110
8062997347,17cyclictest0-21swapper/211:10:282
8062997347,17cyclictest0-21swapper/211:10:282
8062997327,32cyclictest2345-21ls10:35:112
805799733,60cyclictest23664-21apt-get07:55:061
8057997327,35cyclictest0-21swapper/111:24:581
805799732,65cyclictest0-21swapper/108:35:071
805799732,65cyclictest0-21swapper/108:35:071
8057997325,41cyclictest0-21swapper/110:10:051
8057997325,41cyclictest0-21swapper/110:10:051
8052997355,14cyclictest8047-21cyclictest11:07:580
8052997346,10cyclictest30945-21grep09:35:180
805299734,40cyclictest346-21runrttasks09:18:380
805299734,40cyclictest346-21runrttasks09:18:380
8062997257,9cyclictest9993-21apt-key09:54:552
8062997257,9cyclictest9993-21apt-key09:54:552
8062997252,13cyclictest8047-21cyclictest08:20:192
8062997252,13cyclictest8047-21cyclictest08:20:192
806299723,36cyclictest30641-21apt-get09:35:122
8062997223,37cyclictest14657-21sh10:55:182
805799725,62cyclictest0-21swapper/111:50:081
8057997253,13cyclictest4268-21cpu09:45:091
805799724,54cyclictest8795-21ssh10:45:201
8057997230,34cyclictest0-21swapper/109:30:541
8052997234,14cyclictest27870-21grep08:05:310
8062997153,13cyclictest24132-21netstat07:55:222
8062997152,14cyclictest27335-21latency08:05:202
8062997146,14cyclictest0-21swapper/208:30:292
8062997146,14cyclictest0-21swapper/208:30:292
8052997149,12cyclictest0-21swapper/009:20:210
8052997149,12cyclictest0-21swapper/009:20:210
8052997117,20cyclictest20980-21munin-run11:59:540
8052997117,20cyclictest20980-21munin-run11:59:540
807099703,43cyclictest22086-21chrt07:50:233
8062997054,10cyclictest30742-21kworker/u17:3-rpciod10:45:222
8062997052,10cyclictest0-21swapper/208:45:112
8062997052,10cyclictest0-21swapper/208:45:112
8062997049,9cyclictest0-21swapper/210:19:582
8062997044,20cyclictest26154-21timerwakeupswit08:00:282
806299703,44cyclictest11111-21ntp_kernel_pll_08:55:232
806299703,32cyclictest15203-21diskmemload09:49:312
8062997022,36cyclictest21413-21cut09:19:572
8062997022,36cyclictest21413-21cut09:19:572
805799702,59cyclictest5255-21apt-get10:40:041
8052997051,14cyclictest21594-21kworker/u19:1+events_unbound08:19:540
8052997051,14cyclictest21594-21kworker/u19:1+events_unbound08:19:540
8052997049,14cyclictest25238-21ssh11:12:340
8052997049,14cyclictest25238-21ssh11:12:340
8052997022,30cyclictest26819-21latency_hist08:04:570
8052997014,13cyclictest15-21ksoftirqd/008:55:100
8062996944,14cyclictest0-21swapper/210:20:172
8062996944,14cyclictest0-21swapper/210:20:172
8052996947,8cyclictest181rcu_preempt07:50:220
805299693,39cyclictest15333-21latency_hist09:09:580
805299692,33cyclictest5625-21latency_hist08:39:570
805299692,33cyclictest5625-21latency_hist08:39:570
805299692,32cyclictest15580-21fschecks_count07:30:180
125782690,6sleep30-21swapper/310:50:543
8062996851,12cyclictest17968-21latency_hist11:54:562
8062996849,11cyclictest0-21swapper/212:19:552
8062996845,12cyclictest0-21swapper/207:10:332
806299683,45cyclictest6737-21unixbench_singl08:40:312
806299683,45cyclictest6737-21unixbench_singl08:40:312
8062996822,33cyclictest16069-21switchtime07:30:302
805799682,61cyclictest0-21swapper/108:50:071
805799682,61cyclictest0-21swapper/108:50:071
8052996851,11cyclictest13823-21ssh10:00:160
8052996846,10cyclictest181rcu_preempt07:40:180
805299684,32cyclictest17178-21fschecks_count07:35:170
8052996811,30cyclictest181rcu_preempt08:10:300
806299675,41cyclictest346-21runrttasks09:23:372
806299675,41cyclictest346-21runrttasks09:23:372
8062996751,10cyclictest15203-21diskmemload10:10:272
8062996751,10cyclictest15203-21diskmemload10:10:272
806299674,42cyclictest9593-21munin-run12:34:542
806299674,42cyclictest9593-21munin-run12:34:542
806299674,42cyclictest22289-21timerwakeupswit12:00:312
8062996738,14cyclictest0-21swapper/210:00:182
806299672,38cyclictest29640-21ssh10:25:322
806299672,30cyclictest18212-21modprobe09:14:542
287772670,7sleep30-21swapper/312:11:313
8062996648,11cyclictest0-21swapper/210:05:312
8062996644,13cyclictest0-21swapper/211:59:542
8062996644,13cyclictest0-21swapper/211:59:542
8062996642,11cyclictest0-21swapper/211:34:582
806299663,45cyclictest12591-21apt12:39:532
806299663,42cyclictest13943-21fschecks_count07:25:152
806299663,41cyclictest11526-21df10:50:162
8062996621,34cyclictest18835-21seq07:40:152
805299663,51cyclictest7354-21/usr/sbin/munin08:45:230
805299663,51cyclictest7354-21/usr/sbin/munin08:45:230
806299653,43cyclictest346-21runrttasks11:07:042
806299653,42cyclictest1152-21fschecks_time08:25:172
806299653,42cyclictest1152-21fschecks_time08:25:172
805299654,44cyclictest346-21runrttasks09:02:140
8052996544,12cyclictest0-21swapper/007:29:570
8062996447,12cyclictest2063-21switchtime09:40:282
8062996447,12cyclictest2063-21switchtime09:40:282
8062996446,11cyclictest0-21swapper/211:34:552
806299643,33cyclictest25512-21timerandwakeup09:25:322
806299642,43cyclictest28734-21fschecks_count08:10:172
8062996342,13cyclictest0-21swapper/209:30:322
806299632,38cyclictest18466-21latency_hist07:39:582
8052996340,13cyclictest0-21swapper/008:25:130
8052996340,13cyclictest0-21swapper/008:25:130
8052996238,16cyclictest0-21swapper/007:14:570
805299622,42cyclictest21562-21awk07:49:540
807099593,38cyclictest8942-21taskset12:33:073
807099593,38cyclictest8942-21taskset12:33:073
807099573,41cyclictest5047-21chrt09:45:273
8062995720,28cyclictest31245-21sshd08:17:112
8062995720,28cyclictest31245-21sshd08:17:112
807099564,34cyclictest3998-21chrt08:34:573
807099564,34cyclictest3998-21chrt08:34:573
807099563,39cyclictest32125-21chrt09:36:363
807099553,41cyclictest23018-21chrt11:09:463
807099553,37cyclictest19186-21chrt09:15:253
807099553,37cyclictest19186-21chrt09:15:253
807099553,36cyclictest12032-21taskset11:44:563
807099552,37cyclictest6548-21chrt10:41:023
807099552,36cyclictest19771-21chrt11:56:353
807099552,36cyclictest19771-21chrt11:56:353
790825512,25sleep30-21swapper/307:09:553
807099543,35cyclictest25990-21taskset11:14:403
807099543,35cyclictest25990-21taskset11:14:403
807099542,38cyclictest25669-21chrt12:06:123
807099542,38cyclictest25669-21chrt12:06:123
807099542,37cyclictest589-21chrt12:19:543
807099542,34cyclictest17714-21taskset10:05:373
807099536,29cyclictest0-21swapper/311:15:373
807099533,37cyclictest12731-21chrt12:39:563
807099533,36cyclictest1308-21chrt10:33:163
807099533,35cyclictest28004-21taskset09:30:203
807099533,35cyclictest18189-21chrt11:54:573
807099533,34cyclictest18314-21chrt11:00:313
807099533,33cyclictest14912-21chrt10:55:243
807099532,36cyclictest31695-21taskset11:23:043
807099532,36cyclictest26046-21chrt10:20:203
807099532,36cyclictest26046-21chrt10:20:203
807099532,35cyclictest850-21chrt12:19:583
807099532,35cyclictest20662-21taskset10:10:313
807099532,35cyclictest20662-21taskset10:10:313
8070995315,25cyclictest9479-21taskset08:50:233
8070995315,25cyclictest9479-21taskset08:50:233
807099524,32cyclictest18318-21chrt09:14:563
807099523,37cyclictest20311-21chrt07:45:123
807099523,35cyclictest24994-21chrt10:19:063
807099523,34cyclictest26850-21chrt09:28:423
807099523,32cyclictest22716-21chrt09:20:363
807099523,32cyclictest22716-21chrt09:20:363
807099522,35cyclictest7448-21taskset11:35:483
807099522,35cyclictest19275-21chrt07:40:273
807099522,34cyclictest4029-21chrt11:30:293
807099522,34cyclictest4029-21chrt11:30:293
807099513,34cyclictest14264-21taskset09:05:213
807099512,35cyclictest30121-21taskset10:26:313
807099512,34cyclictest31257-21chrt08:17:193
807099512,34cyclictest31257-21chrt08:17:193
807099512,34cyclictest13564-21chrt07:24:563
807099512,34cyclictest13564-21chrt07:24:563
8070995117,22cyclictest15473-21taskset10:02:453
8070995117,21cyclictest4336-21chrt10:38:183
807099504,34cyclictest21807-21chrt12:00:203
807099503,35cyclictest13734-21chrt11:46:303
807099503,32cyclictest32087-21chrt08:20:193
807099503,32cyclictest32087-21chrt08:20:193
807099502,36cyclictest2396-21chrt09:40:413
807099502,36cyclictest2396-21chrt09:40:413
807099502,34cyclictest29126-21chrt08:10:273
807099502,34cyclictest12801-21chrt09:00:273
8070995017,21cyclictest1924-21chrt08:25:423
8070995017,21cyclictest1924-21chrt08:25:423
807099493,34cyclictest9895-21chrt10:46:573
8070994927,14cyclictest451rcuc/309:54:593
8070994927,14cyclictest451rcuc/309:54:593
807099492,35cyclictest2703-21chrt11:29:203
807099492,35cyclictest14077-21chrt07:25:173
8070994817,20cyclictest8467-21chrt07:10:193
8070994815,22cyclictest3933-21chrt12:25:093
8070994716,20cyclictest11041-21chrt08:55:213
8070994715,21cyclictest25739-21chrt08:00:193
8070994714,22cyclictest6910-21chrt08:42:303
8070994714,22cyclictest6910-21chrt08:42:303
807099463,29cyclictest4405-21taskset08:35:173
807099463,29cyclictest4405-21taskset08:35:173
8070994615,19cyclictest18288-21chrt07:39:463
8070994613,21cyclictest23669-21chrt07:55:083
8070994513,21cyclictest7379-21chrt08:45:093
8070994513,21cyclictest7379-21chrt08:45:093
8070994513,21cyclictest28063-21chrt08:07:403
807099443,27cyclictest9850-21taskset07:15:003
8070994412,21cyclictest16451-21chrt07:31:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional