You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-10 - 10:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot4.osadl.org (updated Mon Aug 10, 2026 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2547999722,63cyclictest25504-21/usr/sbin/munin19:51:110
2549599716,59cyclictest0-21swapper/320:31:293
2549599713,31cyclictest3721-21ssh22:32:243
2549599713,31cyclictest3721-21ssh22:32:243
2547999712,63cyclictest11678-21grep21:16:080
2549599706,58cyclictest0-21swapper/321:26:263
2549599705,7cyclictest0-21swapper/323:02:503
2547999702,62cyclictest27798-21ssh21:37:460
2547999702,61cyclictest6792-21/usr/sbin/munin19:01:010
2549599695,7cyclictest0-21swapper/321:05:263
2549599695,58cyclictest0-21swapper/323:45:033
2549599695,58cyclictest0-21swapper/322:23:443
2549599694,7cyclictest0-21swapper/322:06:453
2549599694,7cyclictest0-21swapper/320:36:323
2549599694,33cyclictest0-21swapper/320:53:333
2549599694,32cyclictest0-21swapper/320:42:553
2549599693,6cyclictest0-21swapper/322:16:323
2547999698,54cyclictest0-21swapper/020:52:240
2547999696,56cyclictest0-21swapper/020:30:400
2547999692,61cyclictest29835-21/usr/sbin/munin18:36:130
2547999692,60cyclictest2974-21ssh21:48:030
2549599684,7cyclictest0-21swapper/323:21:283
2549599684,7cyclictest0-21swapper/323:10:533
2549599684,58cyclictest0-21swapper/322:58:403
2549599684,58cyclictest0-21swapper/321:56:033
2549599684,33cyclictest0-21swapper/322:36:453
2549599684,28cyclictest0-21swapper/322:30:363
25483996823,39cyclictest26907-21expr21:36:141
2547999683,58cyclictest28873-21fschecks_time20:56:010
2547999682,60cyclictest16159-21/usr/sbin/munin19:26:170
2547999682,60cyclictest10532-21/usr/sbin/munin19:11:210
2547999682,59cyclictest17811-21diskstats23:35:530
2547999682,33cyclictest27965-21/usr/sbin/munin18:31:110
25479996812,24cyclictest0-21swapper/020:47:450
2549599674,6cyclictest0-21swapper/321:53:223
2549599674,6cyclictest0-21swapper/321:53:223
2549599674,56cyclictest0-21swapper/322:54:593
2549599674,33cyclictest0-21swapper/320:27:293
2549599674,32cyclictest0-21swapper/321:21:403
2549599673,8cyclictest0-21swapper/321:43:493
2549599673,34cyclictest0-21swapper/321:33:523
25495996710,27cyclictest0-21swapper/323:53:563
2547999675,56cyclictest0-21swapper/020:34:530
2547999675,55cyclictest0-21swapper/022:20:460
2547999675,55cyclictest0-21swapper/019:36:030
2547999673,57cyclictest32071-21latency23:11:010
2547999672,59cyclictest3058-21/usr/sbin/munin18:51:060
2547999672,59cyclictest3058-21/usr/sbin/munin18:51:060
2547999672,59cyclictest29244-21/usr/sbin/munin20:01:020
2547999672,59cyclictest27375-21/usr/sbin/munin19:56:030
2547999672,59cyclictest23627-21/usr/sbin/munin19:46:020
2547999672,58cyclictest4761-21ksmtuned20:21:000
2547999672,58cyclictest31111-21/usr/sbin/munin20:06:150
2547999672,33cyclictest8663-21/usr/sbin/munin19:06:100
25479996711,23cyclictest0-21swapper/023:19:200
2549599665,54cyclictest0-21swapper/321:15:443
2549599665,54cyclictest0-21swapper/321:15:443
2549599664,6cyclictest0-21swapper/322:42:073
2549599664,55cyclictest0-21swapper/322:48:243
2549599664,33cyclictest0-21swapper/322:15:363
2549599664,32cyclictest0-21swapper/323:36:423
2549599664,32cyclictest0-21swapper/323:31:383
2549599664,32cyclictest0-21swapper/323:07:273
2549599664,30cyclictest0-21swapper/323:28:353
2549599664,30cyclictest0-21swapper/320:58:293
2549599664,10cyclictest0-21swapper/323:15:573
25483996623,37cyclictest5443-21ssh21:07:221
25483996621,39cyclictest6460-21processes22:36:081
25483996621,39cyclictest18734-21sed20:41:151
2547999665,54cyclictest0-21swapper/021:55:310
2547999665,54cyclictest0-21swapper/021:55:310
2547999663,57cyclictest26093-21/usr/sbin/munin18:26:150
2547999662,58cyclictest539-21/usr/sbin/munin20:11:020
2547999662,58cyclictest19623-21kworker/0:122:05:140
2547999662,58cyclictest15747-21ssh22:49:250
2547999662,57cyclictest17044-21sh21:23:310
25479996612,22cyclictest0-21swapper/023:42:310
25479996611,49cyclictest0-21swapper/023:30:500
25479996610,50cyclictest0-21swapper/022:41:570
2549599654,32cyclictest0-21swapper/321:07:033
2549599653,6cyclictest15931-21latency_hist19:25:473
2549599653,32cyclictest0-21swapper/321:20:443
2549599653,31cyclictest0-21swapper/323:48:383
2549599653,31cyclictest0-21swapper/323:48:383
2549599653,31cyclictest0-21swapper/322:03:343
2547999659,24cyclictest0-21swapper/021:26:470
2547999658,24cyclictest0-21swapper/022:40:390
2547999655,54cyclictest0-21swapper/022:19:310
2547999655,54cyclictest0-21swapper/020:37:290
2547999655,53cyclictest0-21swapper/022:55:530
2547999655,53cyclictest0-21swapper/022:25:450
2547999654,21cyclictest0-21swapper/023:48:330
2547999654,21cyclictest0-21swapper/023:48:330
2547999653,56cyclictest0-21swapper/023:03:240
2547999652,57cyclictest7465-21fschecks_count21:10:570
2547999652,57cyclictest7465-21fschecks_count21:10:570
2547999652,57cyclictest573-21irqbalance22:53:540
2547999652,57cyclictest18014-21/usr/sbin/munin19:30:590
2547999652,29cyclictest7066-21iostat23:21:030
25479996511,48cyclictest0-21swapper/022:10:200
2549599644,53cyclictest0-21swapper/319:35:473
2549599644,29cyclictest0-21swapper/320:47:083
2549599643,35cyclictest4190-21latency_hist21:50:443
2549599642,31cyclictest6567-21latency_hist19:00:473
25483996422,36cyclictest25021-21diskstats20:50:561
2547999649,49cyclictest0-21swapper/020:17:210
2547999649,49cyclictest0-21swapper/020:17:210
2547999648,50cyclictest0-21swapper/023:52:090
2547999648,50cyclictest0-21swapper/020:41:250
2547999647,51cyclictest0-21swapper/022:11:440
2547999645,53cyclictest0-21swapper/023:05:580
2547999645,53cyclictest0-21swapper/022:30:510
2547999645,53cyclictest0-21swapper/022:30:510
2547999645,53cyclictest0-21swapper/021:56:530
2547999645,53cyclictest0-21swapper/021:10:330
2547999645,53cyclictest0-21swapper/021:03:030
2547999643,55cyclictest629-21snmpd23:26:480
2547999643,55cyclictest31178-21ssh21:42:030
2547999642,56cyclictest4927-21/usr/sbin/munin18:56:090
2547999642,56cyclictest1187-21/usr/sbin/munin18:46:010
2547999642,56cyclictest1187-21/usr/sbin/munin18:46:010
2549599632,34cyclictest27740-21munin-run18:30:483
25495996310,47cyclictest0-21swapper/318:35:493
25483996323,34cyclictest7364-21awk23:21:081
2547999635,52cyclictest0-21swapper/021:30:480
2549599624,8cyclictest0-21swapper/318:46:153
2549599624,8cyclictest0-21swapper/318:46:153
2549599624,7cyclictest0-21swapper/319:01:083
2549599624,32cyclictest0-21swapper/319:50:463
2549599623,33cyclictest0-21swapper/319:59:483
2549599622,7cyclictest30816-21chrt20:04:543
25483996223,33cyclictest20308-21ssh23:39:031
2547999622,28cyclictest15724-21sshd19:23:190
2549599614,29cyclictest0-21swapper/320:16:513
2549599614,29cyclictest0-21swapper/320:16:513
2549599614,27cyclictest0-21swapper/321:40:133
2549599613,32cyclictest0-21swapper/319:15:473
2549599613,30cyclictest0-21swapper/320:11:213
25483996122,33cyclictest2465-21/usr/sbin/munin20:16:181
25483996122,33cyclictest2465-21/usr/sbin/munin20:16:181
25483996122,33cyclictest22205-21ssh22:57:201
25483996122,33cyclictest21679-21ssh21:30:361
2549599603,35cyclictest29991-21cpu18:36:003
25483996022,32cyclictest12907-21ssh22:45:531
25483996021,33cyclictest15782-21ssh23:32:141
2549599594,33cyclictest0-21swapper/319:37:223
25483995921,33cyclictest3974-21ssh22:32:571
25483995921,33cyclictest3974-21ssh22:32:571
25483995921,12cyclictest23455-21ssh21:31:201
2547999593,50cyclictest0-21swapper/018:42:300
2549599584,8cyclictest0-21swapper/319:26:153
2547999584,47cyclictest0-21swapper/019:45:460
25490995748,5cyclictest29-21ksoftirqd/222:20:432
2549599563,29cyclictest0-21swapper/320:06:183
2549099565,45cyclictest0-21swapper/223:26:432
25483995640,11cyclictest1827-21unixbench_singl20:11:191
250472549,17sleep10-21swapper/118:23:251
25490995314,34cyclictest29-21ksoftirqd/222:01:092
25490995313,35cyclictest7010-21latency_hist21:10:452
25483995314,33cyclictest23035-21sshd19:41:191
2549099524,42cyclictest0-21swapper/222:26:182
2549599514,6cyclictest0-21swapper/319:20:473
2549099514,6cyclictest0-21swapper/222:56:042
2549099514,41cyclictest0-21swapper/223:14:512
2549099504,41cyclictest0-21swapper/223:16:462
2549099504,40cyclictest0-21swapper/223:01:042
2549099504,40cyclictest0-21swapper/222:21:442
2549099504,40cyclictest0-21swapper/220:56:522
2549099504,19cyclictest0-21swapper/221:52:052
2549099504,19cyclictest0-21swapper/221:52:052
25483995017,28cyclictest29606-21df_inode21:40:571
2549099495,38cyclictest0-21swapper/221:20:542
2549099494,38cyclictest0-21swapper/221:47:562
2549099493,40cyclictest0-21swapper/221:26:462
25490994912,31cyclictest0-21swapper/223:50:562
25483994925,18cyclictest6714-21tune2fs20:26:031
25483994925,18cyclictest16025-21vmstat21:21:171
25483994921,23cyclictest12854-21sh23:28:591
25483994919,24cyclictest14282-21sleep19:20:571
2549099489,34cyclictest0-21swapper/220:26:572
2549099485,37cyclictest0-21swapper/222:44:322
2549099484,38cyclictest0-21swapper/222:14:522
2549099484,38cyclictest0-21swapper/221:31:422
2549099484,37cyclictest0-21swapper/221:11:102
2549099484,37cyclictest0-21swapper/221:11:102
2549099483,39cyclictest0-21swapper/222:40:132
25490994812,5cyclictest0-21swapper/219:16:272
25490994811,31cyclictest0-21swapper/222:07:252
25483994831,12cyclictest543-21systemd-logind19:05:461
25483994826,16cyclictest643-21runrttasks22:30:191
25483994825,18cyclictest5176-21runrttasks23:18:241
25483994824,18cyclictest5930-21timerandwakeup18:56:161
25483994823,19cyclictest9366-21cpu22:40:531
2549099474,38cyclictest0-21swapper/221:42:162
2549099474,37cyclictest0-21swapper/221:40:312
2549099474,37cyclictest0-21swapper/221:16:202
25490994732,10cyclictest0-21swapper/220:34:372
2549099473,39cyclictest0-21swapper/221:05:072
2549099472,5cyclictest31243-21kworker/2:021:59:152
2549099472,41cyclictest29-21ksoftirqd/220:52:172
25490994715,27cyclictest6005-21diskmemload20:35:562
25490994710,31cyclictest0-21swapper/222:46:062
25483994728,13cyclictest8192-21/usr/sbin/munin21:56:071
25483994727,14cyclictest27615-21sshd18:29:191
25483994727,14cyclictest14756-21switchtime20:36:131
25483994723,19cyclictest16769-21df22:50:541
25483994723,18cyclictest9589-21grep19:06:151
25483994722,20cyclictest13364-21ssh21:18:331
25483994722,19cyclictest16271-21memory22:06:021
25483994720,21cyclictest30464-21ssh23:51:531
2547999472,38cyclictest13683-21runrttasks19:16:280
2549099468,7cyclictest0-21swapper/223:40:542
2549099464,9cyclictest0-21swapper/223:32:532
2549099464,37cyclictest0-21swapper/223:25:422
2549099464,37cyclictest0-21swapper/219:20:592
2549099464,36cyclictest0-21swapper/223:08:332
2549099464,36cyclictest0-21swapper/222:53:372
2549099464,36cyclictest0-21swapper/222:30:572
2549099464,36cyclictest0-21swapper/222:30:572
2549099464,36cyclictest0-21swapper/220:16:132
2549099464,36cyclictest0-21swapper/220:16:132
25483994628,12cyclictest24333-21unixbench_multi22:16:131
25483994627,14cyclictest480-21sed18:41:181
25483994627,13cyclictest779-21/usr/sbin/munin21:45:531
25483994627,13cyclictest1929-21ntpdc18:46:091
25483994627,13cyclictest1929-21ntpdc18:46:091
25483994627,13cyclictest12171-21fschecks_count22:00:581
25483994626,14cyclictest643-21runrttasks20:01:181
25483994626,14cyclictest27725-21/usr/sbin/munin23:06:121
25483994626,14cyclictest25680-21runrttasks19:51:001
25483994625,15cyclictest21100-21unixbench_singl19:36:171
25483994624,17cyclictest1733-21diskmemload23:14:031
249292469,14sleep00-21swapper/018:21:590
2549599455,33cyclictest0-21swapper/319:55:473
2549099454,36cyclictest0-21swapper/220:41:472
2549099454,35cyclictest0-21swapper/220:46:252
2549099454,16cyclictest0-21swapper/223:48:572
2549099454,16cyclictest0-21swapper/223:48:572
2549099453,8cyclictest0-21swapper/223:35:542
25483994531,9cyclictest4899-21fschecks_time21:50:581
25483994531,9cyclictest4899-21fschecks_time21:50:581
25483994529,10cyclictest30333-21/usr/sbin/munin18:36:061
25483994527,13cyclictest32250-21/usr/sbin/munin21:01:131
25483994527,13cyclictest27378-21aten_rbpower_cu19:55:581
25483994527,13cyclictest19335-21/usr/sbin/munin22:11:001
25483994526,14cyclictest31376-21tune2fs20:05:591
25483994526,13cyclictest7316-21aten_rbpower_po21:10:541
25483994526,13cyclictest7316-21aten_rbpower_po21:10:541
25483994526,13cyclictest21362-21/usr/sbin/munin23:41:101
25483994523,17cyclictest22962-21ssh20:47:111
25483994522,18cyclictest29252-21ssh22:23:371
25483994521,19cyclictest643-21runrttasks18:35:201
2549599444,9cyclictest0-21swapper/320:21:113
2549599444,9cyclictest0-21swapper/319:06:093
2549599443,36cyclictest0-21swapper/318:42:353
2549599443,35cyclictest0-21swapper/318:51:163
2549599443,35cyclictest0-21swapper/318:51:163
2549599443,11cyclictest0-21swapper/319:45:473
2549099444,34cyclictest0-21swapper/218:41:032
2549099443,8cyclictest22022-21fschecks_count19:41:012
2549099443,35cyclictest0-21swapper/219:39:452
25483994428,10cyclictest18076-21/usr/sbin/munin19:30:581
25483994427,12cyclictest643-21runrttasks20:32:071
25483994427,12cyclictest26365-21unixbench_multi23:46:131
25483994427,12cyclictest26365-21unixbench_multi23:46:131
25483994427,12cyclictest12411-21aten_rbpower_cu19:16:051
25483994426,13cyclictest24696-21/usr/sbin/munin23:01:021
25483994425,14cyclictest28577-21cut20:55:571
25483994425,14cyclictest23627-21/usr/sbin/munin19:45:591
25483994425,13cyclictest3084-21aten_rbpower_cu18:51:001
25483994425,13cyclictest3084-21aten_rbpower_cu18:51:001
25483994424,14cyclictest16158-21chrt19:26:011
25483994421,18cyclictest10935-21cut19:11:041
2549099433,35cyclictest0-21swapper/219:13:562
25483994325,13cyclictest4349-21/usr/sbin/munin20:20:551
2549099424,32cyclictest0-21swapper/220:25:462
2549099423,33cyclictest0-21swapper/218:40:482
2549099414,31cyclictest0-21swapper/220:12:592
251262416,11sleep20-21swapper/218:24:222
193882413,7sleep20-21swapper/219:32:272
327012403,7sleep20-21swapper/220:10:012
251692403,7sleep20-21swapper/219:49:292
177232403,8sleep20-21swapper/219:29:572
2549099394,30cyclictest0-21swapper/219:01:412
2515223714,17sleep30-21swapper/318:24:443
25490993526,5cyclictest29-21ksoftirqd/220:05:462
274152343,7sleep20-21swapper/218:26:562
25490993324,5cyclictest29-21ksoftirqd/218:54:402
25490993324,5cyclictest29-21ksoftirqd/218:54:402
25490993322,7cyclictest26639-21grep19:51:162
25490993315,13cyclictest5947-21timerandwakeup18:56:162
25490993222,7cyclictest28206-21fschecks_count18:31:042
21502322,22sleep22220-21sed18:46:152
21502322,22sleep22220-21sed18:46:152
25490992919,6cyclictest9077-21hwlatdetect19:06:042
25490992817,6cyclictest643-21runrttasks19:56:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional