You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-21 - 00:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Fri Mar 20, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1756021100,7sleep117561-21uname10:18:471
168262880,3sleep2281ktimersoftd/208:42:412
16242840,4sleep226-21rcuc/206:23:342
1241599803,70cyclictest0-21swapper/210:32:062
12413997515,53cyclictest25965-21fschecks_count09:43:441
12413997515,53cyclictest25965-21fschecks_count09:43:441
12415997246,10cyclictest0-21swapper/207:53:412
193542710,3sleep3361ktimersoftd/307:58:403
12415997044,12cyclictest0-21swapper/209:58:252
12415997036,9cyclictest12567-21tune2fs09:23:432
248599690,5rtkit-daemon5712-21ssh10:48:501
12415996937,23cyclictest0-21swapper/208:35:552
12410996737,13cyclictest0-21swapper/008:23:430
12415996641,12cyclictest0-21swapper/209:53:252
12415996639,12cyclictest0-21swapper/207:48:572
12415996637,12cyclictest0-21swapper/207:13:412
12415996540,11cyclictest0-21swapper/208:31:312
12415996539,9cyclictest13989-21head10:13:412
12415996539,12cyclictest0-21swapper/206:24:022
12415996538,13cyclictest0-21swapper/210:22:102
1241099653,54cyclictest0-21swapper/009:53:470
12415996445,14cyclictest0-21swapper/209:18:452
1241599644,54cyclictest0-21swapper/210:04:022
1241599644,54cyclictest0-21swapper/208:48:382
12415996438,13cyclictest0-21swapper/208:15:072
12415996438,12cyclictest0-21swapper/210:38:452
12415996438,12cyclictest0-21swapper/207:43:472
12415996437,13cyclictest0-21swapper/209:11:512
12415996436,13cyclictest0-21swapper/207:03:532
12415996436,12cyclictest0-21swapper/206:58:562
12415996436,12cyclictest0-21swapper/206:58:562
1241099644,52cyclictest0-21swapper/007:43:450
12410996438,8cyclictest20363-21ssh09:33:580
1241599634,52cyclictest15161-21fschecks_count11:03:392
1241599634,52cyclictest15161-21fschecks_count11:03:392
1241599634,52cyclictest0-21swapper/209:28:482
12415996339,9cyclictest7716-21munin-node10:53:452
12415996339,11cyclictest0-21swapper/208:22:022
12415996339,11cyclictest0-21swapper/208:22:022
12415996338,12cyclictest0-21swapper/210:11:022
12415996338,12cyclictest0-21swapper/209:14:552
12415996338,11cyclictest0-21swapper/210:45:072
12415996337,13cyclictest0-21swapper/209:45:322
12415996337,13cyclictest0-21swapper/209:45:322
12415996336,13cyclictest0-21swapper/207:38:512
12415996336,13cyclictest0-21swapper/207:38:512
12415996335,13cyclictest0-21swapper/210:48:492
12415996321,24cyclictest27531-21sort10:33:402
12413996319,14cyclictest0-21swapper/108:58:531
12410996336,12cyclictest0-21swapper/008:08:340
76502623,52sleep00-21swapper/007:40:320
76502623,52sleep00-21swapper/007:40:320
12415996239,7cyclictest20696-21kworker/2:208:43:412
12415996236,13cyclictest0-21swapper/209:06:522
12415996236,13cyclictest0-21swapper/208:53:582
12415996236,13cyclictest0-21swapper/208:26:402
12415996236,12cyclictest0-21swapper/208:03:472
12415996236,12cyclictest0-21swapper/206:09:042
12415996235,13cyclictest0-21swapper/208:59:262
12415996234,13cyclictest0-21swapper/208:08:412
12415996234,11cyclictest0-21swapper/207:58:542
12415996233,11cyclictest0-21swapper/209:39:252
1241399625,39cyclictest0-21swapper/109:07:101
1241599615,50cyclictest0-21swapper/210:23:492
1241599615,50cyclictest0-21swapper/210:23:492
1241599614,9cyclictest121850irq/46-eth009:59:222
12415996139,14cyclictest0-21swapper/207:28:312
1241399614,33cyclictest0-21swapper/108:50:241
1241399614,10cyclictest19871-21awk09:33:501
12410996132,13cyclictest0-21swapper/007:02:590
12410996132,13cyclictest0-21swapper/007:02:590
12416996036,8cyclictest9611-21ssh07:43:473
12415996037,9cyclictest23328-21munin-node07:08:462
12415996036,15cyclictest0-21swapper/206:53:462
12415996034,14cyclictest0-21swapper/209:37:422
1241399606,38cyclictest0-21swapper/108:39:051
1241399606,27cyclictest5715-21diskstats09:13:411
1241399605,31cyclictest0-21swapper/110:28:481
1241399605,16cyclictest0-21swapper/107:46:221
1241399604,38cyclictest0-21swapper/107:57:291
1241399604,14cyclictest0-21swapper/108:30:271
1241399604,13cyclictest1419-21runrttasks09:31:351
1241099604,50cyclictest0-21swapper/008:28:520
12410996036,9cyclictest2461-21rm09:08:430
12410996035,6cyclictest17550-21ssh10:18:470
12410996034,10cyclictest10606-21munin-node08:33:560
206422592,49sleep00-21swapper/008:48:370
12416995928,17cyclictest16401-21ssh08:41:093
1241599595,47cyclictest12919-21runrttasks05:38:472
12415995934,13cyclictest0-21swapper/210:59:362
12415995934,12cyclictest0-21swapper/207:20:252
1241399595,19cyclictest0-21swapper/106:36:061
1241399594,30cyclictest0-21swapper/108:17:321
1241399594,16cyclictest0-21swapper/110:00:391
1241399594,14cyclictest0-21swapper/105:42:061
1241399594,11cyclictest15973-21python11:03:521
1241399594,11cyclictest15973-21python11:03:521
12413995919,14cyclictest17909-21entropy08:43:441
1241099595,16cyclictest0-21swapper/011:03:410
1241099595,16cyclictest0-21swapper/011:03:410
1241099594,48cyclictest0-21swapper/010:38:380
1241099594,41cyclictest0-21swapper/007:57:280
12410995938,9cyclictest24689-21telnet06:03:450
12410995935,10cyclictest0-21swapper/007:58:510
12410995929,12cyclictest0-21swapper/005:43:550
210572580,3sleep1201ktimersoftd/110:23:471
210572580,3sleep1201ktimersoftd/110:23:471
12416995833,9cyclictest3286-21ssh09:08:563
12416995829,17cyclictest18363-21ssh07:56:213
12415995843,11cyclictest0-21swapper/206:03:462
12415995837,8cyclictest8997-21munin-node06:39:042
12415995833,12cyclictest0-21swapper/205:59:032
1241399585,28cyclictest0-21swapper/107:13:521
1241399585,15cyclictest0-21swapper/108:56:431
1241399585,14cyclictest11517-21df10:58:351
1241399585,13cyclictest0-21swapper/106:12:111
1241399584,14cyclictest0-21swapper/110:43:411
1241399584,13cyclictest21241-21chrt07:59:061
1241399584,13cyclictest0-21swapper/105:48:351
1241399584,12cyclictest0-21swapper/109:27:041
12413995822,13cyclictest0-21swapper/110:55:281
12410995844,8cyclictest41ktimersoftd/010:58:410
12410995836,8cyclictest26618-21kworker/0:010:43:440
12410995836,10cyclictest0-21swapper/009:48:450
12410995834,10cyclictest0-21swapper/010:03:240
12410995834,10cyclictest0-21swapper/008:47:140
12416995727,17cyclictest15584-21ssh10:16:053
1241599576,29cyclictest0-21swapper/206:44:012
1241399575,29cyclictest0-21swapper/106:43:541
1241399575,28cyclictest0-21swapper/110:13:471
1241399575,14cyclictest0-21swapper/110:09:261
1241399574,35cyclictest0-21swapper/109:50:291
1241399574,29cyclictest0-21swapper/106:48:551
1241399574,29cyclictest0-21swapper/105:38:361
1241399574,28cyclictest0-21swapper/108:08:441
1241399574,14cyclictest0-21swapper/110:04:471
1241399574,13cyclictest0-21swapper/107:48:411
12413995719,23cyclictest5995-21forks07:38:471
12413995719,23cyclictest5995-21forks07:38:471
12413995718,15cyclictest0-21swapper/109:20:131
12413995718,14cyclictest0-21swapper/106:53:581
12410995736,7cyclictest5144-21diskmemload08:18:490
12410995736,7cyclictest5144-21diskmemload08:18:490
12410995734,8cyclictest7187-21ssh10:03:440
12410995734,11cyclictest0-21swapper/009:17:240
12410995734,10cyclictest9772-21munin-node10:08:420
12410995733,9cyclictest14128-21ssh10:13:430
12410995733,10cyclictest0-21swapper/010:23:330
12410995733,10cyclictest0-21swapper/010:23:330
12410995733,10cyclictest0-21swapper/005:57:170
1241099573,46cyclictest7652-21latency_hist10:53:230
105632573,10sleep30-21swapper/308:33:323
12416995625,14cyclictest0-21swapper/310:03:243
12416995625,13cyclictest0-21swapper/310:49:523
12415995637,10cyclictest0-21swapper/206:28:502
12415995622,13cyclictest0-21swapper/206:53:322
1241399565,28cyclictest0-21swapper/108:03:301
1241399565,27cyclictest1419-21runrttasks05:59:021
1241399565,27cyclictest0-21swapper/106:28:561
1241399565,22cyclictest0-21swapper/110:38:191
1241399565,12cyclictest924-21diskstats08:18:431
1241399565,12cyclictest924-21diskstats08:18:431
1241399564,30cyclictest0-21swapper/108:25:281
1241399564,29cyclictest0-21swapper/106:23:491
1241399564,28cyclictest0-21swapper/107:23:301
1241399564,26cyclictest0-21swapper/109:38:491
12413995618,16cyclictest0-21swapper/109:57:211
12413995617,14cyclictest0-21swapper/109:08:481
12410995634,9cyclictest8474-21munin-node09:18:580
12410995634,11cyclictest0-21swapper/007:05:290
12410995634,10cyclictest0-21swapper/006:43:310
10202563,46sleep00-21swapper/009:07:190
12416995535,7cyclictest19395-21rm08:44:493
12416995533,9cyclictest13776-21munin-node06:49:003
12416995533,8cyclictest26856-21rm10:33:333
12416995533,8cyclictest10032-21ssh08:32:233
1241599555,29cyclictest0-21swapper/205:53:492
12415995541,9cyclictest0-21swapper/206:34:072
12415995521,13cyclictest0-21swapper/207:38:142
1241399555,26cyclictest0-21swapper/108:34:321
1241399554,29cyclictest0-21swapper/110:40:041
1241399554,28cyclictest0-21swapper/107:23:581
1241399554,27cyclictest0-21swapper/107:12:211
12410995534,8cyclictest25300-21munin-node09:43:380
12410995534,8cyclictest25300-21munin-node09:43:380
12410995534,10cyclictest0-21swapper/009:38:440
12410995534,10cyclictest0-21swapper/007:52:400
12410995533,9cyclictest31721-21munin-node06:18:470
12410995533,9cyclictest30488-21munin-node07:23:530
12410995522,19cyclictest10319-21ssh10:56:350
12416995424,12cyclictest0-21swapper/309:48:593
1241599545,27cyclictest0-21swapper/206:14:002
1241599545,27cyclictest0-21swapper/206:14:002
1241399544,28cyclictest0-21swapper/107:28:411
1241399543,24cyclictest0-21swapper/107:05:281
1241099544,44cyclictest5144-21diskmemload08:13:380
1241099544,44cyclictest25501-21rm08:53:560
1241099544,44cyclictest24910-21rm08:05:120
12410995435,7cyclictest17518-21ssh09:30:350
12410995433,8cyclictest6612-21munin-node06:33:470
12410995433,10cyclictest0-21swapper/009:01:520
12410995433,10cyclictest0-21swapper/006:50:080
12410995432,10cyclictest0-21swapper/007:15:310
12416995342,6cyclictest361ktimersoftd/306:29:013
12416995334,7cyclictest5144-21diskmemload09:04:133
12416995333,8cyclictest6804-21sed09:13:583
12416995333,7cyclictest23984-21rm08:53:343
12416995331,9cyclictest18561-21munin-node09:33:583
12416995324,13cyclictest0-21swapper/308:58:443
12416995322,14cyclictest0-21swapper/310:03:453
12415995319,8cyclictest17178-21munin-run05:48:342
1241399534,25cyclictest19885-21aten2.4-expect05:53:451
12410995334,7cyclictest12399-21cyclictest10:36:530
12410995332,8cyclictest24707-21python10:28:550
12410995330,8cyclictest12175-21ssh09:23:390
1241099533,45cyclictest16626-21rm08:41:580
12410995325,13cyclictest0-21swapper/006:43:480
325552522,9sleep30-21swapper/307:27:333
244562522,9sleep30-21swapper/309:41:213
12416995238,8cyclictest32024-21ssh09:53:363
12416995233,7cyclictest2406-21rm08:19:153
12416995233,7cyclictest2406-21rm08:19:153
12416995233,7cyclictest22453-21ssh10:26:413
12416995233,7cyclictest22453-21ssh10:26:413
12416995226,12cyclictest0-21swapper/309:43:523
12416995226,12cyclictest0-21swapper/309:43:523
12416995225,12cyclictest0-21swapper/310:28:453
12416995224,12cyclictest0-21swapper/309:21:563
12416995223,13cyclictest0-21swapper/307:53:293
12416995219,12cyclictest0-21swapper/308:23:443
1241599524,27cyclictest0-21swapper/207:28:422
1241399524,25cyclictest0-21swapper/106:22:121
1241399524,13cyclictest0-21swapper/106:59:011
1241399524,13cyclictest0-21swapper/106:59:011
12410995231,10cyclictest0-21swapper/007:12:550
12410995230,11cyclictest0-21swapper/006:14:590
12410995230,11cyclictest0-21swapper/006:14:590
12410995230,10cyclictest0-21swapper/007:36:570
12410995221,13cyclictest0-21swapper/005:38:560
266722513,42sleep10-21swapper/106:08:061
12416995131,8cyclictest13650-21kworker/3:009:32:323
12416995131,8cyclictest12292-21ssh10:11:193
12416995127,10cyclictest0-21swapper/307:33:483
12416995123,13cyclictest0-21swapper/310:18:433
12416995120,13cyclictest0-21swapper/308:08:563
1241599513,34cyclictest0-21swapper/205:49:052
1241399516,23cyclictest0-21swapper/105:48:441
12410995136,10cyclictest0-21swapper/006:08:350
63152502,42sleep00-21swapper/006:32:480
302202502,9sleep30-21swapper/307:23:093
12416995032,7cyclictest5144-21diskmemload09:24:423
12416995031,7cyclictest9074-21rm10:53:503
12416995030,8cyclictest5144-21diskmemload11:02:303
12416995024,12cyclictest0-21swapper/310:44:573
12416995023,13cyclictest0-21swapper/311:07:593
12416995023,13cyclictest0-21swapper/311:07:593
12416995019,14cyclictest0-21swapper/308:14:393
1241399504,30cyclictest0-21swapper/107:33:551
12410995037,8cyclictest3514-21grep06:24:060
12410995032,12cyclictest0-21swapper/006:00:240
12410995031,14cyclictest0-21swapper/007:22:140
217112492,9sleep30-21swapper/305:55:383
12416994930,7cyclictest7184-21sh06:33:473
12416994930,7cyclictest23174-21ssh08:51:243
12416994925,11cyclictest22736-21munin-node08:03:503
12416994924,10cyclictest5982-21diskstats07:38:473
12416994924,10cyclictest5982-21diskstats07:38:473
12416994922,12cyclictest0-21swapper/310:38:403
12416994921,13cyclictest0-21swapper/306:28:343
12416994921,12cyclictest0-21swapper/307:13:593
108422492,40sleep30-21swapper/306:39:363
89952483,9sleep10-21swapper/106:38:411
266522482,39sleep30-21swapper/306:07:523
12416994820,9cyclictest18317-21crond06:58:313
12410994830,13cyclictest0-21swapper/005:49:490
155852472,39sleep30-21swapper/305:43:493
1241399474,28cyclictest0-21swapper/106:14:071
1241399474,28cyclictest0-21swapper/106:14:071
1241699464,35cyclictest0-21swapper/306:08:443
12416994627,7cyclictest27853-21kworker/3:107:28:413
12416994625,7cyclictest14789-21munin-run05:43:343
12416994622,9cyclictest31721-21munin-node06:19:023
12416994621,10cyclictest31461-21sshd06:18:173
12416994621,10cyclictest31461-21sshd06:18:173
1241099464,35cyclictest0-21swapper/006:53:460
12410994630,11cyclictest0-21swapper/007:30:370
1241699453,35cyclictest11959-21diskstats06:43:483
12416994526,8cyclictest20940-21munin-node07:04:003
12416994518,13cyclictest0-21swapper/305:59:063
1241699443,35cyclictest0-21swapper/307:03:313
1241699443,35cyclictest0-21swapper/307:03:313
1241699443,34cyclictest0-21swapper/307:08:413
1241699443,13cyclictest0-21swapper/305:48:433
121882443,35sleep00-21swapper/005:36:090
1241599413,23cyclictest0-21swapper/205:38:352
12416993624,7cyclictest12433-21latency_hist05:38:353
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional