You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-13 - 09:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot2.osadl.org (updated Thu Aug 13, 2026 00:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
58115199175134,25cyclictest0-21swapper/300:20:413
58115199171130,37cyclictest10550irq/205-8000000.ethernet-rx022:45:443
581149991461,20cyclictest777971-21sh00:40:021
5811509914584,48cyclictest691297-21sendmail-msp22:41:072
581151991417,115cyclictest742389-21df_inode23:50:333
581151991417,115cyclictest742389-21df_inode23:50:333
581148991331,41cyclictest773406-21kworker/u16:7+rpciod00:40:020
5811519913096,29cyclictest0-21swapper/323:20:493
58115199128113,9cyclictest81-21hwrng21:44:533
58115199126120,4cyclictest461ktimers/322:50:213
58115199126115,6cyclictest81-21hwrng22:36:053
58115099126108,7cyclictest81-21hwrng20:20:552
58114999124114,6cyclictest81-21hwrng23:13:591
58114999124114,6cyclictest81-21hwrng23:13:591
5811519912376,25cyclictest0-21swapper/321:21:123
5811519912294,21cyclictest0-21swapper/319:21:063
58115199119109,7cyclictest81-21hwrng20:21:573
58114899119110,5cyclictest81-21hwrng22:15:370
58115199118108,4cyclictest10550irq/205-8000000.ethernet-rx022:10:103
58115199118108,4cyclictest10550irq/205-8000000.ethernet-rx022:10:103
5811509911834,52cyclictest9950irq/131-8000000.ethernet-tx221:00:502
581151991174,95cyclictest641904-21ntpq21:30:553
581151991174,95cyclictest641904-21ntpq21:30:553
58115199117109,4cyclictest650624-21kworker/u16:24+events_unbound23:31:083
58115199116103,9cyclictest81-21hwrng20:16:503
5811489911669,37cyclictest171ktimers/019:25:360
58115199115107,6cyclictest461ktimers/300:30:223
58115199115107,6cyclictest461ktimers/300:30:223
58115199115101,5cyclictest81-21hwrng19:44:043
58115099115105,6cyclictest81-21hwrng22:00:152
581151991146,102cyclictest756293-21sleep00:10:023
58115199114103,5cyclictest10550irq/205-8000000.ethernet-rx023:40:133
5811489911419,85cyclictest0-21swapper/023:50:540
5811489911419,85cyclictest0-21swapper/023:50:540
5811519911379,30cyclictest45-21rcuc/321:10:543
581151991135,93cyclictest731424-21cut23:35:303
58115199113104,6cyclictest81-21hwrng23:02:433
5811489911397,6cyclictest81-21hwrng22:40:110
5811519911210,73cyclictest746344-21irqstats23:55:413
58115199112107,3cyclictest0-21swapper/321:25:233
581148991111,91cyclictest0-21swapper/000:05:400
581148991091,100cyclictest750432-21ntpq00:01:090
5811519910737,58cyclictest0-21swapper/320:40:163
5811509910767,35cyclictest9950irq/131-8000000.ethernet-tx200:00:252
5811489910610,71cyclictest0-21swapper/022:56:010
581151991054,66cyclictest47-21ksoftirqd/323:10:273
581151991054,66cyclictest47-21ksoftirqd/323:10:273
5811509910594,3cyclictest81-21hwrng23:26:162
5811499910584,19cyclictest0-21swapper/121:21:031
5811519910499,3cyclictest10550irq/205-8000000.ethernet-rx022:20:263
5811519910416,81cyclictest667262-21ntpq22:05:563
5811519910365,32cyclictest0-21swapper/300:00:133
581151991032,66cyclictest47-21ksoftirqd/320:30:213
5811509910313,73cyclictest0-21swapper/222:20:312
5811489910249,30cyclictest171ktimers/020:55:190
581148991021,76cyclictest597811-21kworker/u16:5+rpciod20:01:110
581148991011,76cyclictest622113-21kworker/u16:3+rpciod21:40:270
58115099991,29cyclictest56-21kcompactd000:25:192
581149999953,26cyclictest599885-21sendmail-msp20:01:191
581151999894,2cyclictest4650ktimers/300:15:173
581150999891,4cyclictest0-21swapper/220:10:492
581149999883,7cyclictest81-21hwrng22:30:581
581151999774,18cyclictest0-21swapper/300:10:473
581150999684,6cyclictest0-21swapper/222:05:462
581149999664,15cyclictest10550irq/205-8000000.ethernet-rx019:40:431
58114999961,53cyclictest735420-21fschecks_count23:41:011
58114899962,61cyclictest633659-21apt-get21:20:240
58114899961,90cyclictest758775-21kworker/u16:5+rpciod00:30:030
581151999573,19cyclictest709737-21cut23:05:333
581148999568,19cyclictest10550irq/205-8000000.ethernet-rx021:25:450
581151999431,57cyclictest662349-21sendmail-msp22:01:493
58114999941,72cyclictest716783-21ssh23:15:161
58115199938,54cyclictest659067-21rm21:55:233
581149999385,4cyclictest81-21hwrng22:13:341
581149999385,4cyclictest81-21hwrng22:13:341
581149999326,52cyclictest0-21swapper/123:20:561
581149999322,66cyclictest10050irq/139-8000000.ethernet-tx323:55:311
581151999267,13cyclictest0-21swapper/322:40:163
58115099926,18cyclictest722053-21sed23:21:292
581149999227,42cyclictest365422-21kworker/u16:9+xprtiod20:21:091
581148999176,5cyclictest662349-21sendmail-msp22:01:430
58115199907,56cyclictest47-21ksoftirqd/321:45:363
581150999025,61cyclictest734573-21sendmail-msp23:41:272
581149999067,18cyclictest732193-21ssh23:35:511
581149999065,20cyclictest0-21swapper/122:01:291
58114899901,78cyclictest0-21swapper/021:11:080
581151998966,19cyclictest461ktimers/319:10:153
58115099897,21cyclictest584688-21kworker/u16:6+rpciod19:41:072
58115199886,45cyclictest47-21ksoftirqd/323:47:203
58115199882,4cyclictest0-21swapper/320:01:023
581150998878,7cyclictest81-21hwrng21:45:552
58115099887,27cyclictest635932-21kworker/u16:18+xprtiod21:40:022
581150998829,56cyclictest381ktimers/220:25:522
58115099882,18cyclictest695444-21aten_r8power_vo22:45:322
581149998859,27cyclictest0-21swapper/121:40:331
581149998832,41cyclictest751446-21kworker/u16:19+xprtiod00:25:251
581149998822,62cyclictest0-21swapper/122:41:131
581150998730,40cyclictest628583-21kworker/u16:5+rpciod21:25:392
58115099872,21cyclictest684746-21diskstats22:30:362
581149998772,13cyclictest301ktimers/119:21:011
581149998722,54cyclictest9950irq/131-8000000.ethernet-tx222:20:471
581148998778,5cyclictest81-21hwrng23:05:470
58115099868,3cyclictest741999-21apt-get23:50:222
58115099868,3cyclictest741999-21apt-get23:50:222
581150998677,5cyclictest81-21hwrng00:20:322
581149998677,6cyclictest81-21hwrng22:18:411
581149998654,21cyclictest0-21swapper/121:00:021
58114999863,61cyclictest648039-21ssh21:40:041
58114999861,28cyclictest661273-21sh21:57:331
581148998628,46cyclictest9950irq/131-8000000.ethernet-tx221:00:260
581151998558,19cyclictest461ktimers/319:45:183
581150998522,48cyclictest0-21swapper/200:30:392
581150998522,48cyclictest0-21swapper/200:30:392
58115099852,12cyclictest707433-21ssh23:01:252
581148998532,46cyclictest655808-21ssh21:50:370
581151998471,10cyclictest461ktimers/321:00:593
58115199841,64cyclictest0-21swapper/323:16:073
581150998475,5cyclictest81-21hwrng23:55:582
58115099845,25cyclictest660708-21sleep21:56:152
58115099844,5cyclictest671545-21/usr/sbin/munin22:11:132
58115099844,5cyclictest671545-21/usr/sbin/munin22:11:132
581150998443,36cyclictest0-21swapper/222:15:362
581149998475,5cyclictest301ktimers/120:30:471
58114999841,6cyclictest10550irq/205-8000000.ethernet-rx022:26:081
581149998411,52cyclictest9950irq/131-8000000.ethernet-tx220:40:181
581148998464,15cyclictest81-21hwrng23:35:290
581151998358,17cyclictest461ktimers/320:25:573
581151998358,14cyclictest461ktimers/322:26:033
581151998336,42cyclictest45-21rcuc/319:35:033
581150998373,7cyclictest81-21hwrng21:21:202
58115099834,46cyclictest739403-21systemd-userwor23:45:502
58115099831,27cyclictest656384-21ntpq21:50:532
58114999839,64cyclictest0-21swapper/121:01:231
581149998317,54cyclictest707973-21kworker/u16:12+rpciod23:10:031
58114999831,16cyclictest633354-21unix_chkpwd21:20:011
581148998322,41cyclictest758773-21kworker/u16:2+xprtiod00:20:170
58115099827,36cyclictest727952-21ssh23:30:332
58115099823,35cyclictest56-21kcompactd023:10:172
58115099823,35cyclictest56-21kcompactd023:10:172
581150998231,43cyclictest0-21swapper/222:25:462
581150998219,56cyclictest0-21swapper/220:00:012
58115099821,75cyclictest586772-21apt-get19:25:122
58115099821,38cyclictest641787-21/usr/sbin/munin21:30:452
58115099821,38cyclictest641787-21/usr/sbin/munin21:30:452
581149998233,40cyclictest705709-21sendmail-msp23:00:591
581148998261,12cyclictest0-21swapper/023:40:230
58114899821,42cyclictest77-21kswapd023:20:190
581151998152,22cyclictest461ktimers/320:50:473
581151998147,25cyclictest461ktimers/319:15:433
581151998147,25cyclictest461ktimers/319:15:433
58115099813,21cyclictest648493-21aten_r8power_fr21:40:522
58115099812,8cyclictest0-21swapper/219:35:252
58115099812,8cyclictest0-21swapper/219:35:252
581150998126,42cyclictest753531-21expr00:05:432
58115099812,12cyclictest606000-21fschecks_count20:15:372
581149998130,46cyclictest698792-21ssh22:50:141
581149998129,38cyclictest736795-21kworker/u16:16+rpciod00:00:071
58114999811,67cyclictest763736-21ssh00:20:121
58114999811,4cyclictest759913-21cat00:15:031
581148998118,53cyclictest9950irq/131-8000000.ethernet-tx220:41:050
581150998053,16cyclictest0-21swapper/220:41:192
58115099802,34cyclictest626058-21diskmemload23:35:142
58114999804,67cyclictest590742-21apt-get19:35:151
58114999804,67cyclictest590742-21apt-get19:35:151
58115199796,39cyclictest47-21ksoftirqd/321:35:193
581151997956,12cyclictest0-21swapper/300:25:173
581151997914,53cyclictest47-21ksoftirqd/322:34:563
581151997911,65cyclictest656526-21ntp_states21:51:043
581150997934,39cyclictest10550irq/205-8000000.ethernet-rx019:21:042
581150997926,39cyclictest0-21swapper/221:10:392
581150997924,49cyclictest0-21swapper/200:20:022
58115099792,31cyclictest709719-21apt-get23:05:322
581149997973,4cyclictest81-21hwrng22:49:241
581149997936,39cyclictest656590-21sh21:51:081
58114999791,4cyclictest0-21swapper/121:26:181
58114899793,26cyclictest635932-21kworker/u16:18+xprtiod21:40:040
58114899791,71cyclictest666277-21ssh22:05:230
58115199784,56cyclictest702395-21ssh22:55:143
581150997842,33cyclictest699901-21ssh22:50:592
58115099783,25cyclictest625171-21ntpq21:05:452
581150997831,41cyclictest614035-21ntpq20:35:562
581150997815,60cyclictest630411-21df_inode21:15:362
58115099781,38cyclictest644-21snmpd20:06:022
58114999782,73cyclictest688054-21ssh22:35:271
58114999781,60cyclictest626394-21ssh21:10:171
58114999781,35cyclictest653047-21ssh21:46:111
58114999781,28cyclictest587856-21modprobe19:26:091
581148997834,38cyclictest772059-21ssh00:31:050
581148997834,38cyclictest772059-21ssh00:31:050
58114899781,75cyclictest661779-21ssh21:58:440
581148997810,62cyclictest0-21swapper/022:35:490
581151997771,3cyclictest0-21swapper/300:40:023
581150997745,27cyclictest0-21swapper/222:55:492
58115099773,7cyclictest0-21swapper/219:35:022
58115099771,29cyclictest717493-21ssh23:15:422
581148997722,51cyclictest0-21swapper/023:01:240
58114899771,70cyclictest678382-21ssh22:21:230
581148997712,51cyclictest0-21swapper/022:50:030
581150997628,41cyclictest0-21swapper/220:00:182
58115099762,18cyclictest757008-21gltestperf00:10:382
58115099761,35cyclictest776388-21ssh00:36:332
58115099761,28cyclictest688326-21/usr/sbin/munin22:35:322
581149997628,42cyclictest10550irq/205-8000000.ethernet-rx020:46:081
581149997625,36cyclictest601057-21kworker/u16:16+rpciod20:20:041
58114999761,8cyclictest582279-21/usr/sbin/munin19:11:041
58114999761,3cyclictest595699-21timerwakeupswit19:46:101
58114999761,34cyclictest643738-21ssh21:33:541
58114999761,34cyclictest643738-21ssh21:33:541
58114999761,33cyclictest753801-21/usr/sbin/munin00:05:481
58114899764,60cyclictest630158-21aten_r8power_cu21:15:310
581148997629,44cyclictest597369-21sendmail_mailtr19:51:060
581148997626,35cyclictest579230-21kworker/u16:21+xprtiod19:30:130
581148997619,48cyclictest0-21swapper/019:45:440
58114899761,70cyclictest0-21swapper/023:46:020
58115199755,32cyclictest47-21ksoftirqd/323:25:073
581149997551,14cyclictest0-21swapper/122:55:391
581149997531,38cyclictest728531-21ssh23:30:471
58114999751,6cyclictest771587-21ssh00:30:421
58114999751,6cyclictest771587-21ssh00:30:421
58114999751,30cyclictest743811-21ssh23:51:271
58114999751,30cyclictest743811-21ssh23:51:271
581148997553,18cyclictest0-21swapper/021:45:380
581148997531,40cyclictest747205-21timerwakeupswit23:56:130
58114899751,60cyclictest562562-21kworker/u16:18+rpciod19:20:160
58115199746,46cyclictest0-21swapper/322:20:033
581151997446,15cyclictest461ktimers/321:19:013
581151997441,24cyclictest45-21rcuc/319:25:153
58115099744,24cyclictest620657-21apt-get20:55:182
581150997441,30cyclictest620132-21unixbench_singl20:51:092
581150997414,45cyclictest0-21swapper/220:35:032
58114999749,62cyclictest10150irq/147-8000000.ethernet-tx422:05:131
581149997457,6cyclictest81-21hwrng21:05:591
581148997438,32cyclictest607377-21sendmail-msp20:21:160
581148997427,42cyclictest612314-21cat20:31:090
581148997418,50cyclictest0-21swapper/020:46:080
58114899741,70cyclictest715755-21ssh23:13:200
58114899741,70cyclictest715755-21ssh23:13:200
581151997354,13cyclictest0-21swapper/320:05:373
581150997334,35cyclictest617736-21ntpq20:45:502
581149997338,31cyclictest598378-21awk19:55:291
58114999732,67cyclictest761130-21/usr/sbin/munin00:15:541
58114999731,67cyclictest739908-21/usr/sbin/munin23:46:111
58114899736,64cyclictest9850irq/123-8000000.ethernet-tx123:15:370
58114899731,68cyclictest724951-21ssh23:25:480
58114899731,55cyclictest0-21swapper/020:10:550
581151997246,23cyclictest461ktimers/319:50:253
581151997217,38cyclictest461ktimers/320:45:543
581149997237,30cyclictest0-21swapper/120:50:351
58114999721,4cyclictest0-21swapper/123:25:161
58114999721,2cyclictest0-21swapper/120:26:081
58114899722,59cyclictest698764-21apt-get22:50:110
581148997225,42cyclictest0-21swapper/019:35:140
581148997225,42cyclictest0-21swapper/019:35:140
581148997225,35cyclictest584687-21kworker/u16:3+xprtiod19:40:390
58114899721,68cyclictest761261-21ntpq00:16:030
58114899721,61cyclictest640960-21ssh21:30:260
58114899721,61cyclictest640960-21ssh21:30:260
581150997142,25cyclictest584443-21timerwakeupswit19:16:082
581150997142,25cyclictest584443-21timerwakeupswit19:16:082
58114999711,65cyclictest604560-21/usr/sbin/munin20:10:401
58114999711,64cyclictest585070-21latency_hist19:20:031
58114999711,64cyclictest585070-21latency_hist19:20:031
58114899712,63cyclictest687795-21latency_hist22:35:020
581148997116,47cyclictest0-21swapper/022:11:060
581148997116,47cyclictest0-21swapper/022:11:060
581148997115,35cyclictest608997-21kworker/u16:12+xprtiod20:40:030
58115099703,53cyclictest0-21swapper/219:50:362
581150997014,43cyclictest10550irq/205-8000000.ethernet-rx019:10:352
58115099701,31cyclictest595507-21mailstats19:46:082
58114999701,63cyclictest596839-21gltestperf19:50:371
58114899708,55cyclictest757527-21ntpq00:10:560
58114899701,63cyclictest606052-21fschecks_time20:15:370
581148996936,25cyclictest680859-21ssh22:25:300
581148996921,41cyclictest0-21swapper/019:10:450
581149996831,34cyclictest589440-21kernelversion19:30:401
581149996826,37cyclictest602385-21/usr/sbin/munin20:05:361
58114899681,62cyclictest729591-21ssh23:31:550
58114999671,59cyclictest613189-21apt-get20:35:171
58114899674,59cyclictest609457-21/usr/sbin/munin20:25:350
581148996745,19cyclictest171ktimers/019:55:230
58115199662,51cyclictest47-21ksoftirqd/320:55:223
581148996624,37cyclictest644-21snmpd20:05:400
581148996614,42cyclictest10550irq/205-8000000.ethernet-rx021:06:080
58114899654,51cyclictest583222-21/usr/sbin/munin19:15:380
58114899654,51cyclictest583222-21/usr/sbin/munin19:15:380
581151996347,11cyclictest461ktimers/320:10:143
581148996325,32cyclictest1857-21lldpd20:50:180
58115199622,33cyclictest47-21ksoftirqd/320:35:353
58114999591,18cyclictest581343-21latency_hist19:10:031
58115199571,40cyclictest590742-21apt-get19:35:143
58115199571,40cyclictest590742-21apt-get19:35:143
58115099573,16cyclictest581318-21ls19:10:032
581151995639,14cyclictest0-21swapper/319:55:443
58115199551,18cyclictest624430-21sshd-auth21:05:153
581148995435,10cyclictest0-21swapper/019:10:020
581151994330,10cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional