You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-27 - 16:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Wed May 27, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23941212513,82sleep223953-21modprobe07:00:192
240859910253,13cyclictest181rcu_preempt08:25:560
240909910070,9cyclictest181rcu_preempt07:35:552
240909910070,9cyclictest181rcu_preempt07:35:552
24085999752,17cyclictest181rcu_preempt11:12:540
24085999752,17cyclictest181rcu_preempt11:12:540
24089999552,33cyclictest24077-21cyclictest09:35:381
24085999534,17cyclictest181rcu_preempt07:30:520
24089999471,16cyclictest29269-21latency_hist10:45:201
24090999253,18cyclictest181rcu_preempt10:21:052
24090999253,18cyclictest181rcu_preempt10:21:052
24090999120,33cyclictest0-21swapper/209:53:392
24089999114,39cyclictest17653-21ls10:25:351
24085999153,8cyclictest181rcu_preempt07:00:520
24085999152,21cyclictest181rcu_preempt10:02:490
24089999073,11cyclictest26754-21gpgv11:35:211
24090998966,15cyclictest32716-21mailstats09:55:512
24090998964,19cyclictest8330-21sh09:15:462
2408599899,62cyclictest27762-21diskstats11:36:270
2408599899,62cyclictest27762-21diskstats11:36:270
24090998858,9cyclictest181rcu_preempt12:15:212
24085998870,13cyclictest11085-21ntpd10:20:530
24085998870,13cyclictest11085-21ntpd10:20:530
24085998745,8cyclictest181rcu_preempt11:59:520
24085998745,8cyclictest181rcu_preempt11:59:520
24089998669,11cyclictest7635-21ssh11:55:531
24089998669,11cyclictest7635-21ssh11:55:531
24089998634,40cyclictest16469-21apt-get08:15:311
24085998612,51cyclictest15-21ksoftirqd/010:30:180
24090998548,13cyclictest181rcu_preempt11:55:482
24090998548,13cyclictest181rcu_preempt11:55:482
24090998543,12cyclictest181rcu_preempt10:31:382
24090998540,8cyclictest181rcu_preempt09:33:512
24090998540,8cyclictest181rcu_preempt09:33:512
24089998567,11cyclictest22685-21systemd-run08:35:201
24089998548,28cyclictest10973-21grep07:55:551
24085998565,12cyclictest31226-21cpuspeed07:20:350
24085998558,18cyclictest8329-21latency_hist07:50:220
24085998515,42cyclictest15-21ksoftirqd/009:55:510
24090998456,8cyclictest181rcu_preempt08:45:222
24089998427,27cyclictest0-21swapper/109:50:441
24085998452,8cyclictest181rcu_preempt09:17:570
24090998351,11cyclictest181rcu_preempt12:27:532
24090998351,11cyclictest181rcu_preempt12:27:532
24089998363,14cyclictest30985-21diskmemload10:15:551
24085998353,8cyclictest181rcu_preempt11:30:090
2409099828,32cyclictest27325-21ssh11:35:372
2409099828,32cyclictest27325-21ssh11:35:372
24090998262,11cyclictest0-21swapper/210:40:512
24090998258,15cyclictest24427-21timerandwakeup10:35:532
24085998262,12cyclictest28009-21apt-get08:51:000
24085998252,8cyclictest181rcu_preempt10:45:350
24085998244,24cyclictest181rcu_preempt09:49:080
24085998236,14cyclictest181rcu_preempt07:05:430
24085998228,20cyclictest0-21swapper/012:25:360
24085998228,20cyclictest0-21swapper/012:25:360
2408599822,50cyclictest15-21ksoftirqd/011:05:210
2408599822,50cyclictest15-21ksoftirqd/011:05:210
24090998156,13cyclictest0-21swapper/209:10:222
24090998143,8cyclictest181rcu_preempt07:15:422
24090998141,13cyclictest181rcu_preempt10:08:212
24090998141,13cyclictest181rcu_preempt10:08:212
24090998136,8cyclictest181rcu_preempt07:50:562
24085998161,10cyclictest0-21swapper/011:10:180
24085998156,8cyclictest181rcu_preempt10:55:390
24085998156,10cyclictest181rcu_preempt08:20:500
24085998141,14cyclictest181rcu_preempt08:03:150
24085998140,8cyclictest181rcu_preempt11:33:470
24085998138,32cyclictest15733-21kworker/u17:0+nfsiod10:05:580
24085998138,32cyclictest15733-21kworker/u17:0+nfsiod10:05:580
24085998138,14cyclictest181rcu_preempt10:17:110
24085998136,14cyclictest0-21swapper/011:21:270
24090998055,18cyclictest1563-21latency_hist09:05:212
24090998045,14cyclictest4148-21ssh10:02:232
24085998034,14cyclictest181rcu_preempt10:31:470
24090997967,9cyclictest24077-21cyclictest11:10:142
24090997958,10cyclictest0-21swapper/208:15:452
24090997956,15cyclictest30985-21diskmemload12:20:532
24090997944,13cyclictest181rcu_preempt12:15:472
24090997944,13cyclictest181rcu_preempt12:15:472
24085997956,17cyclictest30985-21diskmemload09:14:350
24085997949,12cyclictest181rcu_preempt12:03:580
24090997859,12cyclictest24077-21cyclictest08:05:222
24090997856,7cyclictest181rcu_preempt10:55:382
24089997857,15cyclictest7352-21processes07:45:531
24085997842,8cyclictest181rcu_preempt09:00:480
24090997760,9cyclictest0-21swapper/211:10:352
24090997760,9cyclictest0-21swapper/211:10:352
24090997755,8cyclictest181rcu_preempt08:30:402
24090997755,14cyclictest27165-21sh11:35:222
24090997751,8cyclictest181rcu_preempt09:25:462
2409099773,28cyclictest8123-21modprobe07:50:182
24090997731,12cyclictest181rcu_preempt10:15:542
2408999779,32cyclictest0-21swapper/110:55:371
24089997757,14cyclictest25550-21switchtime12:25:521
24089997757,14cyclictest25550-21switchtime12:25:521
24089997755,16cyclictest4011-21fschecks_count11:50:381
24085997755,14cyclictest2374-21systemd-journal09:20:500
24085997755,14cyclictest2374-21systemd-journal09:20:500
24090997641,12cyclictest181rcu_preempt10:29:262
2409099763,61cyclictest32549-21ssh10:50:302
2409099763,60cyclictest3793-21ssh11:50:282
2409099762,38cyclictest39-21ksoftirqd/209:40:322
2409099762,38cyclictest39-21ksoftirqd/209:40:322
2408999766,34cyclictest21024-21apt-get11:25:291
24089997658,11cyclictest13620-21kworker/u17:2-xprtiod10:30:381
24089997654,16cyclictest28662-21sendmail09:50:181
24089997654,16cyclictest1-21systemd09:20:191
24085997660,10cyclictest25508-21sh09:44:520
24085997660,10cyclictest25508-21sh09:44:520
24085997658,13cyclictest18968-21fschecks_count12:15:390
24085997658,13cyclictest18968-21fschecks_count12:15:390
24085997644,26cyclictest352-21runrttasks11:53:260
24085997639,13cyclictest181rcu_preempt12:21:390
24085997636,8cyclictest181rcu_preempt08:55:470
24085997632,22cyclictest181rcu_preempt09:53:350
24085997632,12cyclictest181rcu_preempt08:50:200
24085997630,11cyclictest181rcu_preempt08:10:210
24085997630,11cyclictest181rcu_preempt08:10:210
24090997553,15cyclictest24077-21cyclictest11:45:432
24090997553,15cyclictest24077-21cyclictest11:45:432
24090997546,19cyclictest30985-21diskmemload12:05:212
24090997520,20cyclictest0-21swapper/211:25:132
24089997555,14cyclictest8532-21acpi10:10:291
24089997554,15cyclictest2377-21latency_hist10:00:211
24089997520,22cyclictest6486-21cron07:45:181
24089997520,22cyclictest6486-21cron07:45:181
24089997515,24cyclictest8543-21runrttasks07:50:371
24085997541,10cyclictest181rcu_preempt07:30:180
24085997534,19cyclictest58-21kcompactd007:42:310
24085997534,19cyclictest58-21kcompactd007:42:310
2408599753,36cyclictest25303-21ssh10:37:440
24085997522,25cyclictest0-21swapper/011:15:520
2382727511,36sleep00-21swapper/006:58:500
2409099744,27cyclictest381ktimers/208:25:442
2409099742,27cyclictest11148-21ssh09:20:412
2409099742,27cyclictest11148-21ssh09:20:412
24089997458,11cyclictest24077-21cyclictest10:35:401
24089997455,13cyclictest25493-21sh09:44:501
24089997455,13cyclictest25493-21sh09:44:501
24085997451,14cyclictest19212-21diskmemload09:33:550
24085997451,14cyclictest19212-21diskmemload09:33:550
24085997436,10cyclictest181rcu_preempt09:35:430
24085997433,8cyclictest181rcu_preempt12:10:220
24085997432,8cyclictest181rcu_preempt12:11:100
24085997427,14cyclictest181rcu_preempt08:40:460
24090997329,12cyclictest181rcu_preempt09:49:402
24090997324,13cyclictest181rcu_preempt08:40:222
24089997355,12cyclictest16740-21timerwakeupswit12:10:551
24089997354,14cyclictest24077-21cyclictest09:25:281
2408999733,61cyclictest17139-21seq09:30:441
2408999733,61cyclictest17139-21seq09:30:441
24089997318,21cyclictest7551-21true09:15:191
24089997318,16cyclictest0-21swapper/111:13:421
24089997318,16cyclictest0-21swapper/111:13:421
24085997350,8cyclictest181rcu_preempt07:50:360
24085997336,8cyclictest181rcu_preempt09:05:410
24085997329,18cyclictest0-21swapper/009:25:490
24090997236,16cyclictest181rcu_preempt08:05:522
24090997236,16cyclictest181rcu_preempt08:05:522
24090997235,8cyclictest181rcu_preempt07:25:302
24090997233,8cyclictest181rcu_preempt10:10:442
24090997233,7cyclictest181rcu_preempt07:20:302
24089997257,11cyclictest24077-21cyclictest11:21:241
24089997256,10cyclictest2051-21sh09:05:391
2408999723,35cyclictest28962-21unixbench_multi08:51:271
2408999722,50cyclictest32705-21cat07:25:221
24089997216,23cyclictest0-21swapper/108:20:541
24089997210,25cyclictest13346-21grep12:05:461
24085997247,9cyclictest181rcu_preempt11:46:230
24085997247,9cyclictest181rcu_preempt11:46:230
24085997235,8cyclictest181rcu_preempt10:14:560
24085997234,9cyclictest181rcu_preempt08:35:350
24085997234,12cyclictest0-21swapper/007:39:170
24085997234,12cyclictest0-21swapper/007:39:170
2409299715,51cyclictest0-21swapper/311:35:343
2409299715,51cyclictest0-21swapper/311:35:343
2409299713,50cyclictest23874-21chrt10:35:403
24090997153,8cyclictest0-21swapper/208:45:422
24090997133,13cyclictest181rcu_preempt10:47:132
24090997132,7cyclictest181rcu_preempt11:27:102
24089997154,12cyclictest16884-21ssh11:17:581
24089997152,13cyclictest30175-21open_inodes10:45:501
2408999713,52cyclictest2374-21systemd-journal10:05:181
2408999713,47cyclictest28908-21grep07:10:541
24089997129,27cyclictest13222-21apt-get08:05:341
24089997129,27cyclictest13222-21apt-get08:05:341
24089997116,20cyclictest0-21swapper/112:01:411
24085997142,8cyclictest181rcu_preempt08:15:300
24085997136,9cyclictest58-21kcompactd011:44:560
24085997136,7cyclictest181rcu_preempt08:10:350
24085997135,7cyclictest181rcu_preempt10:50:340
2409299703,54cyclictest27473-21chrt08:50:193
2409299703,51cyclictest11625-21chrt08:00:333
2409299702,54cyclictest9057-21chrt11:05:303
24090997047,14cyclictest5038-21kworker/u17:0-ext4-rsv-conversion12:10:222
24090997036,11cyclictest181rcu_preempt07:10:332
24089997048,16cyclictest19676-21snmpd08:35:551
24089997045,18cyclictest2791-21sh11:48:291
24089997045,18cyclictest2791-21sh11:48:291
2408999703,45cyclictest31064-21latency_hist07:20:221
2408999703,43cyclictest4317-21timerandwakeup07:35:531
2408999703,43cyclictest4317-21timerandwakeup07:35:531
24089997017,24cyclictest26398-21fschecks_time08:45:421
24089997012,19cyclictest352-21runrttasks11:38:371
24089997012,19cyclictest352-21runrttasks11:38:371
24085997047,10cyclictest181rcu_preempt07:56:330
2409299693,51cyclictest29192-21chrt09:50:383
2409299692,54cyclictest26807-21taskset12:28:423
2409299692,54cyclictest26807-21taskset12:28:423
24090996952,11cyclictest170-21jbd2/mmcblk2p2-811:00:412
24090996952,11cyclictest170-21jbd2/mmcblk2p2-811:00:412
24090996943,8cyclictest181rcu_preempt07:09:312
24090996940,12cyclictest181rcu_preempt11:15:442
24090996935,8cyclictest181rcu_preempt09:35:402
24090996920,38cyclictest2577-21systemctl07:30:512
24089996947,15cyclictest6714-21proc_pri11:00:501
24089996947,15cyclictest6714-21proc_pri11:00:501
24089996932,24cyclictest24279-21apt-get07:00:321
24089996922,38cyclictest0-21swapper/112:20:291
24089996918,22cyclictest0-21swapper/110:50:381
24085996934,9cyclictest181rcu_preempt10:40:420
24085996931,9cyclictest181rcu_preempt07:14:010
24085996930,16cyclictest181rcu_preempt07:20:210
24085996916,31cyclictest15-21ksoftirqd/008:30:440
2409299683,51cyclictest14873-21chrt08:10:343
2409299682,51cyclictest14625-21taskset11:15:033
2409299682,51cyclictest14625-21taskset11:15:033
24090996843,9cyclictest181rcu_preempt11:41:212
24089996812,25cyclictest352-21runrttasks11:40:351
2409299673,51cyclictest24389-21taskset09:41:423
2409299673,51cyclictest24389-21taskset09:41:423
2409299673,51cyclictest20759-21chrt10:30:373
2409299673,50cyclictest8645-21chrt11:05:063
2409299673,50cyclictest8645-21chrt11:05:063
2409299673,50cyclictest27739-21chrt09:47:463
2409299673,50cyclictest12140-21chrt10:15:463
2409299672,53cyclictest1395-21taskset11:45:473
2409299672,53cyclictest1395-21taskset11:45:473
2409299672,52cyclictest26432-21chrt11:34:323
2409299672,51cyclictest390-21taskset09:55:533
2409299672,51cyclictest28399-21chrt07:10:443
2409299672,51cyclictest14948-21chrt10:20:413
2409299672,51cyclictest14948-21chrt10:20:413
24090996740,8cyclictest181rcu_preempt08:10:392
24090996734,11cyclictest181rcu_preempt07:55:452
24090996723,11cyclictest30551-21unixbench_multi08:55:542
2408999673,45cyclictest11733-21latency_hist11:10:201
2409299663,50cyclictest9156-21chrt10:10:483
2409299663,49cyclictest32327-21taskset07:23:113
2409299663,49cyclictest16627-21chrt08:15:403
2409299663,48cyclictest5960-21taskset09:10:573
2409299663,48cyclictest13821-21chrt09:25:323
2409299663,48cyclictest0-21swapper/311:25:293
2409299662,52cyclictest1190-21chrt10:50:563
2409299662,51cyclictest5140-21chrt11:51:353
2409299662,51cyclictest22273-21chrt09:39:103
2409299662,50cyclictest3607-21chrt07:35:353
2409299662,50cyclictest3607-21chrt07:35:353
24090996633,10cyclictest181rcu_preempt09:10:412
24089996649,11cyclictest12405-21timerandwakeup08:00:531
2408999663,43cyclictest31276-21/usr/sbin/munin09:00:431
2408999663,41cyclictest15292-21awk10:20:501
2408999663,41cyclictest15292-21awk10:20:501
24089996614,21cyclictest10810-21apt-get09:20:321
24089996614,21cyclictest10810-21apt-get09:20:321
2409299653,50cyclictest7209-21taskset11:55:443
2409299653,50cyclictest7209-21taskset11:55:443
2409299653,50cyclictest19696-21chrt10:28:513
2409299653,49cyclictest19966-21chrt11:23:133
2409299653,47cyclictest19241-21taskset08:23:173
2409299652,51cyclictest21907-21chrt12:20:363
2409299652,50cyclictest8543-21chrt07:50:373
2409299652,49cyclictest30355-21taskset10:45:533
24090996541,18cyclictest28281-21fschecks_time08:51:112
24090996533,8cyclictest181rcu_preempt07:00:342
24090996532,11cyclictest181rcu_preempt07:40:472
24090996532,11cyclictest181rcu_preempt07:40:472
24090996531,11cyclictest181rcu_preempt08:20:472
2408999654,41cyclictest29818-21fschecks_count08:55:391
2408999653,39cyclictest25233-21switchtime08:40:531
24089996519,39cyclictest0-21swapper/110:05:281
24089996519,39cyclictest0-21swapper/110:05:281
2409299644,47cyclictest0-21swapper/309:05:323
2409299643,48cyclictest28200-21chrt08:51:043
2409299643,48cyclictest20904-21chrt08:29:003
2409299643,44cyclictest0-21swapper/308:05:323
2409299643,44cyclictest0-21swapper/308:05:323
2409299642,50cyclictest3237-21chrt10:55:343
2409299642,50cyclictest16426-21chrt11:16:413
2409299642,49cyclictest2227-21chrt07:30:413
2409299642,49cyclictest18942-21chrt12:15:373
2409299642,49cyclictest18942-21chrt12:15:373
2409299642,48cyclictest31467-21chrt11:41:133
24089996444,13cyclictest0-21swapper/108:15:201
24089996444,13cyclictest0-21swapper/107:05:431
2263126413,23sleep10-21swapper/106:55:371
2409299633,49cyclictest24807-21chrt07:00:483
2409299633,49cyclictest17952-21chrt12:13:593
2409299633,48cyclictest15469-21chrt12:10:193
2409299633,47cyclictest30549-21chrt08:55:543
2409299633,47cyclictest27556-21chrt07:09:103
2409299633,46cyclictest10538-21chrt07:55:483
2409299632,49cyclictest26805-21taskset10:40:383
2409299632,49cyclictest21468-21chrt08:30:383
2409299632,49cyclictest11067-21chrt12:01:273
2409299632,48cyclictest933-21chrt09:03:443
2409299632,48cyclictest9155-21chrt09:16:333
2409299632,48cyclictest7045-21chrt10:07:073
2409299632,48cyclictest7045-21chrt10:07:073
2409299632,48cyclictest5305-21chrt07:40:373
2409299632,48cyclictest5305-21chrt07:40:373
2409299632,48cyclictest462-21taskset07:25:383
2409299632,47cyclictest11408-21taskset09:20:463
2409299632,47cyclictest11408-21taskset09:20:463
24089996341,12cyclictest0-21swapper/107:25:511
24089996328,22cyclictest19683-21apt-get08:25:311
2409299622,49cyclictest17838-21chrt09:31:533
2409299622,49cyclictest17838-21chrt09:31:533
2409299622,48cyclictest3373-21chrt10:00:513
2409299622,47cyclictest29704-21chrt07:15:383
2409299622,47cyclictest24693-21chrt08:40:393
24089996234,19cyclictest1946-21apt-get07:30:341
2409299613,46cyclictest7836-21chrt07:47:013
2409299612,46cyclictest24059-21taskset08:37:513
24089996141,13cyclictest21424-21kworker/u18:312:20:181
24089996141,13cyclictest21424-21kworker/u18:312:20:181
2409299493,32cyclictest24091-21chrt07:00:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional