You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 02:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Wed Mar 11, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
550599280,27cyclictest0-21swapper/210:20:152
5506992713,13cyclictest0-21swapper/312:01:443
550699270,27cyclictest0-21swapper/307:21:433
550599260,1cyclictest0-21swapper/209:51:512
550399260,25cyclictest0-21swapper/011:02:350
550699250,24cyclictest31234-21diskmemload10:41:483
550699250,1cyclictest0-21swapper/310:51:013
5503992524,1cyclictest0-21swapper/009:30:390
550399250,24cyclictest31234-21diskmemload12:35:050
550399250,24cyclictest12188-21ssh10:56:260
5506992423,1cyclictest31234-21diskmemload11:47:263
5506992423,1cyclictest0-21swapper/311:10:203
5506992422,1cyclictest0-21swapper/310:01:273
550699240,23cyclictest31234-21diskmemload09:49:393
550699240,23cyclictest0-21swapper/310:49:013
550699240,23cyclictest0-21swapper/310:28:423
5505992423,1cyclictest31234-21diskmemload10:43:372
5505992422,1cyclictest0-21swapper/212:21:152
5505992422,1cyclictest0-21swapper/211:00:012
5505992422,1cyclictest0-21swapper/208:10:012
550599240,2cyclictest26913-21ssh11:41:342
550599240,23cyclictest9055-21ssh11:23:562
550599240,23cyclictest31234-21diskmemload12:09:352
550599240,23cyclictest0-21swapper/210:00:142
550599240,1cyclictest20962-21sh09:31:392
550599240,1cyclictest0-21swapper/211:59:492
550499241,22cyclictest29992-21idleruntime-cro08:00:011
550499240,24cyclictest0-21swapper/110:48:131
550499240,24cyclictest0-21swapper/109:29:311
550499240,23cyclictest31234-21diskmemload10:17:451
550499240,23cyclictest0-21swapper/111:37:341
550499240,23cyclictest0-21swapper/111:05:041
550499240,23cyclictest0-21swapper/109:33:581
550499240,1cyclictest31234-21diskmemload09:50:011
5503992424,0cyclictest31234-21diskmemload10:37:120
5503992422,2cyclictest31234-21diskmemload09:12:200
550399240,2cyclictest313-21systemd-journal11:15:010
550399240,2cyclictest25089-21sh12:10:460
550399240,24cyclictest0-21swapper/009:24:330
550399240,23cyclictest5257-21ssh10:16:580
550399240,23cyclictest0-21swapper/009:46:030
550399240,1cyclictest31234-21diskmemload10:21:210
550399240,1cyclictest0-21swapper/011:58:490
550399240,0cyclictest0-21swapper/011:34:000
550399240,0cyclictest0-21swapper/009:16:130
5506992323,0cyclictest0-21swapper/312:15:333
5506992323,0cyclictest0-21swapper/312:10:523
5506992323,0cyclictest0-21swapper/309:40:203
5506992322,1cyclictest12052-21ssh12:28:563
5506992321,1cyclictest9676-21ssh09:51:343
5506992321,1cyclictest0-21swapper/312:07:163
5506992321,1cyclictest0-21swapper/309:59:373
5506992321,1cyclictest0-21swapper/309:31:463
550699230,23cyclictest0-21swapper/311:15:533
550699230,23cyclictest0-21swapper/310:17:563
550699230,23cyclictest0-21swapper/309:35:103
550699230,22cyclictest24312-21rm10:05:083
550699230,22cyclictest18964-21sh12:36:193
550699230,22cyclictest0-21swapper/311:55:513
550699230,22cyclictest0-21swapper/311:23:003
550699230,1cyclictest6325-21diskmemload12:23:043
550699230,1cyclictest17479-21ssh11:01:423
550699230,0cyclictest31234-21diskmemload11:33:333
550699230,0cyclictest0-21swapper/311:50:363
550699230,0cyclictest0-21swapper/311:50:363
5505992323,0cyclictest31234-21diskmemload11:29:342
5505992323,0cyclictest0-21swapper/211:45:352
5505992323,0cyclictest0-21swapper/209:55:162
5505992323,0cyclictest0-21swapper/209:13:032
5505992322,1cyclictest4220-21diskmemload09:46:102
5505992321,1cyclictest0-21swapper/212:30:202
5505992321,1cyclictest0-21swapper/212:27:252
5505992321,1cyclictest0-21swapper/210:48:382
5505992321,1cyclictest0-21swapper/210:28:542
5505992320,2cyclictest765-21ssh09:41:532
550599230,23cyclictest0-21swapper/211:50:492
550599230,23cyclictest0-21swapper/211:50:492
550599230,22cyclictest31234-21diskmemload11:05:022
550599230,22cyclictest30179-21sh10:11:102
550599230,22cyclictest29848-21sh12:15:032
550599230,22cyclictest25395-21ssh11:39:332
550599230,0cyclictest31234-21diskmemload11:12:022
550599230,0cyclictest0-21swapper/212:36:522
550599230,0cyclictest0-21swapper/211:17:072
550599230,0cyclictest0-21swapper/210:53:102
550599230,0cyclictest0-21swapper/210:37:492
550599230,0cyclictest0-21swapper/209:22:002
5504992323,0cyclictest31234-21diskmemload11:57:371
5504992323,0cyclictest0-21swapper/111:21:121
5504992323,0cyclictest0-21swapper/110:26:451
5504992323,0cyclictest0-21swapper/110:11:171
5504992321,1cyclictest16489-21sh11:00:021
5504992321,1cyclictest0-21swapper/112:21:271
5504992321,1cyclictest0-21swapper/108:16:421
5504992320,2cyclictest6765-21sh10:51:001
5504992320,2cyclictest30277-21sh11:12:511
5504992320,2cyclictest12393-21sh12:29:261
5504992313,2cyclictest0-21swapper/108:51:431
550499230,2cyclictest25277-21sh12:11:031
550499230,23cyclictest0-21swapper/111:50:381
550499230,23cyclictest0-21swapper/111:50:381
550499230,23cyclictest0-21swapper/111:45:261
550499230,23cyclictest0-21swapper/111:30:331
550499230,23cyclictest0-21swapper/110:42:351
550499230,23cyclictest0-21swapper/110:35:371
550499230,22cyclictest31234-21diskmemload09:50:591
550499230,22cyclictest17972-21apt-get07:36:411
550499230,22cyclictest0-21swapper/112:15:561
550499230,22cyclictest0-21swapper/112:05:321
550499230,22cyclictest0-21swapper/110:56:521
550499230,22cyclictest0-21swapper/109:20:051
550499230,0cyclictest0-21swapper/111:40:261
5503992323,0cyclictest31234-21diskmemload12:30:020
5503992323,0cyclictest0-21swapper/012:05:260
5503992323,0cyclictest0-21swapper/011:42:090
5503992323,0cyclictest0-21swapper/011:25:140
5503992323,0cyclictest0-21swapper/011:15:510
5503992323,0cyclictest0-21swapper/010:45:080
5503992323,0cyclictest0-21swapper/010:40:390
5503992323,0cyclictest0-21swapper/010:06:430
5503992323,0cyclictest0-21swapper/009:56:430
5503992321,1cyclictest25474-21ssh11:08:230
5503992321,1cyclictest20627-21apt-get07:40:020
5503992321,1cyclictest18587-21ssh10:31:180
550399230,2cyclictest17543-21ssh12:02:250
550399230,23cyclictest0-21swapper/010:12:140
550399230,22cyclictest7158-21apt-get10:51:420
550399230,22cyclictest5051-21sh11:20:250
550399230,22cyclictest31234-21diskmemload09:35:320
550399230,22cyclictest30534-21ssh09:40:240
550399230,22cyclictest14217-21ssh10:26:460
550399230,22cyclictest12335-21ssh09:52:560
550399230,22cyclictest10258-21processes12:26:510
550399230,22cyclictest0-21swapper/010:01:500
550399230,1cyclictest0-21swapper/011:39:590
550399230,0cyclictest0-21swapper/012:15:350
5506992222,0cyclictest31234-21diskmemload10:35:443
5506992222,0cyclictest31234-21diskmemload10:13:323
5506992222,0cyclictest0-21swapper/310:55:313
5506992221,1cyclictest16823-21sendmail08:40:013
5506992220,1cyclictest0-21swapper/309:10:513
5506992220,1cyclictest0-21swapper/308:00:013
550699220,21cyclictest31234-21diskmemload09:15:553
550699220,21cyclictest27064-21apt-get11:41:453
550699220,21cyclictest16673-21rm12:33:003
550699220,21cyclictest13216-21ssh11:27:193
550699220,21cyclictest10400-21rm09:21:223
550699220,21cyclictest0-21swapper/311:05:193
550699220,1cyclictest31234-21diskmemload11:36:103
550699220,1cyclictest21517-21diskmemload10:33:133
5505992222,0cyclictest0-21swapper/209:35:182
5505992221,1cyclictest0-21swapper/210:30:262
5505992219,3cyclictest0-21swapper/210:15:462
550599220,2cyclictest4823-21ls08:15:002
550599220,21cyclictest28862-21wc09:05:002
550599220,21cyclictest18207-21hddtemp_smartct11:01:472
550599220,21cyclictest0-21swapper/212:00:062
550599220,21cyclictest0-21swapper/210:06:312
550599220,21cyclictest0-21swapper/209:25:412
550599220,21cyclictest0-21swapper/207:21:432
550599220,1cyclictest0-21swapper/211:31:012
550599220,1cyclictest0-21swapper/209:15:452
5504992222,0cyclictest0-21swapper/110:31:361
5504992222,0cyclictest0-21swapper/110:06:131
5504992222,0cyclictest0-21swapper/109:16:411
5504992220,1cyclictest606-21dbus-daemon08:35:001
5504992220,1cyclictest25778-21chrt09:36:021
5504992220,1cyclictest12709-21munin-run07:25:011
5504992220,1cyclictest0-21swapper/112:35:021
550499220,22cyclictest347-21ssh09:41:511
550499220,22cyclictest0-21swapper/109:13:311
550499220,21cyclictest15359-21apt-get12:01:431
550499220,21cyclictest0-21swapper/107:26:441
550499220,21cyclictest0-21swapper/107:11:441
550499220,1cyclictest32646-21ssh11:16:131
550499220,1cyclictest10855-21ssh11:26:241
550499220,1cyclictest0-21swapper/109:57:331
5503992220,1cyclictest17500-21munin-run07:35:000
550399220,22cyclictest0-21swapper/012:22:090
550399220,22cyclictest0-21swapper/011:54:360
550399220,22cyclictest0-21swapper/011:54:360
550399220,21cyclictest0-21swapper/009:25:260
550399220,1cyclictest22039-21apt-get08:51:440
550399220,0cyclictest0-21swapper/007:51:430
550699210,21cyclictest0-21swapper/310:20:113
550699210,20cyclictest0-21swapper/309:06:453
550699210,20cyclictest0-21swapper/307:16:453
550699210,0cyclictest24438-21apt-get08:56:463
5505992120,1cyclictest25583-21apt-get07:51:432
5505992120,0cyclictest0-21swapper/207:16:452
550599210,20cyclictest0-21swapper/209:06:452
550599210,20cyclictest0-21swapper/208:36:432
5504992121,0cyclictest0-21swapper/108:46:431
5504992120,0cyclictest19994-21apt-get07:40:021
550499210,21cyclictest0-21swapper/110:20:491
550499210,20cyclictest0-21swapper/108:06:431
5503992121,0cyclictest17249-21apt-get08:41:420
550399210,20cyclictest0-21swapper/009:01:440
5506992020,0cyclictest2773-21apt-get08:11:433
5506992020,0cyclictest10045-21apt-get08:26:443
5506992020,0cyclictest0-21swapper/308:51:433
5506992020,0cyclictest0-21swapper/307:26:443
5506992019,0cyclictest19643-21apt-get08:46:443
550599200,20cyclictest0-21swapper/208:46:432
550599200,0cyclictest0-21swapper/208:26:432
5504992020,0cyclictest0-21swapper/108:26:431
5504992019,1cyclictest0-21swapper/107:46:441
550499200,0cyclictest0-21swapper/108:56:461
5503992020,0cyclictest0-21swapper/008:01:430
5503992019,1cyclictest9665-21perf08:25:000
550399200,0cyclictest0-21swapper/008:26:430
5506991919,0cyclictest0-21swapper/308:41:423
5505991919,0cyclictest0-21swapper/208:16:422
5505991918,1cyclictest7649-21apt-get08:21:432
5504991919,0cyclictest0-21swapper/108:45:011
5504991919,0cyclictest0-21swapper/108:21:431
5503991919,0cyclictest326-21apt-get08:06:430
5503991919,0cyclictest0-21swapper/007:11:440
5506991818,0cyclictest0-21swapper/307:11:443
5505991818,0cyclictest0-21swapper/208:56:462
5504991818,0cyclictest0-21swapper/108:11:431
5504991818,0cyclictest0-21swapper/107:31:451
5503991818,0cyclictest0-21swapper/008:56:460
5503991818,0cyclictest0-21swapper/008:11:430
5503991818,0cyclictest0-21swapper/007:26:440
5503991816,1cyclictest7276-21awk08:20:000
550399180,17cyclictest0-21swapper/007:56:430
5505991717,0cyclictest0-21swapper/208:51:442
5505991717,0cyclictest0-21swapper/207:41:442
5504991717,0cyclictest14834-21apt-get08:36:431
5504991717,0cyclictest0-21swapper/107:16:451
5504991716,1cyclictest0-21swapper/109:06:451
5504991715,1cyclictest32408-21apt08:05:011
5503991717,0cyclictest0-21swapper/008:46:440
5503991717,0cyclictest0-21swapper/007:36:410
5503991716,0cyclictest23192-21apt-get07:46:440
5506991616,0cyclictest0-21swapper/307:40:023
5506991615,1cyclictest5222-21apt-get08:16:423
5506991615,0cyclictest0-21swapper/308:21:433
550699160,15cyclictest0-21swapper/307:51:453
550699160,0cyclictest0-21swapper/308:31:433
5505991616,0cyclictest0-21swapper/207:56:432
5505991616,0cyclictest0-21swapper/207:11:442
5505991614,1cyclictest0-21swapper/207:50:012
5504991616,0cyclictest0-21swapper/107:51:431
550399165,10cyclictest9821-21timerwakeupswit07:16:540
5505991515,0cyclictest0-21swapper/208:01:432
5504991515,0cyclictest0-21swapper/109:01:441
550399150,14cyclictest0-21swapper/009:07:380
5506991414,0cyclictest0-21swapper/307:30:123
550699140,14cyclictest0-21swapper/309:00:383
550699140,14cyclictest0-21swapper/307:35:033
550699140,0cyclictest0-21swapper/308:06:073
550699140,0cyclictest0-21swapper/308:00:563
550699140,0cyclictest0-21swapper/307:45:513
550599140,14cyclictest0-21swapper/208:41:152
550599140,14cyclictest0-21swapper/207:36:292
550599140,14cyclictest0-21swapper/207:26:232
550599140,0cyclictest0-21swapper/208:30:062
550599140,0cyclictest0-21swapper/207:30:032
5503991414,0cyclictest0-21swapper/008:30:370
550399140,14cyclictest0-21swapper/008:35:130
550399140,14cyclictest0-21swapper/007:21:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional