You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-29 - 19:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot7s.osadl.org (updated Fri May 29, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
895021210,0sleep20-21swapper/210:12:272
2312329581,9sleep20-21swapper/207:08:162
2324329165,8sleep00-21swapper/007:09:460
2293528967,6sleep10-21swapper/107:06:351
2294228468,10sleep30-21swapper/307:06:413
233222510,0sleep10-21swapper/112:35:071
113062310,0sleep30-21swapper/312:27:333
2335199260,25cyclictest0-21swapper/211:05:522
2335199260,25cyclictest0-21swapper/211:05:512
2335199250,25cyclictest0-21swapper/209:54:352
2334299252,11cyclictest537-21snmpd09:42:050
2335199230,22cyclictest0-21swapper/210:16:282
2334699232,20cyclictest29917-21unixbench_singl11:40:261
2335199220,22cyclictest0-21swapper/210:39:492
2335199220,21cyclictest0-21swapper/212:36:342
2335199220,21cyclictest0-21swapper/211:48:142
2334699221,20cyclictest22085-21ssh12:15:121
2335199216,8cyclictest23195-21grep10:20:262
2335199210,21cyclictest0-21swapper/211:19:332
2335199210,21cyclictest0-21swapper/211:12:282
23353992019,1cyclictest0-21swapper/309:48:013
2335399200,16cyclictest0-21swapper/310:22:433
23351992018,1cyclictest0-21swapper/212:08:282
2335199200,20cyclictest0-21swapper/210:09:072
23346992019,1cyclictest0-21swapper/112:25:131
23346992019,1cyclictest0-21swapper/110:37:441
23342992019,1cyclictest0-21swapper/012:14:040
23353991918,1cyclictest0-21swapper/310:53:333
23353991910,6cyclictest23008-21apache209:44:013
23351991919,0cyclictest0-21swapper/209:23:132
2335199190,15cyclictest0-21swapper/208:25:132
2334699191,17cyclictest8580-21apt-get08:05:121
2334699190,18cyclictest0-21swapper/110:28:011
2335399180,2cyclictest0-21swapper/311:19:423
2335399180,16cyclictest0-21swapper/312:16:303
2335199180,18cyclictest0-21swapper/211:39:462
2335199180,18cyclictest0-21swapper/211:20:432
2335199180,15cyclictest0-21swapper/212:17:192
2334699181,3cyclictest8960-21kworker/u8:010:11:181
23342991816,1cyclictest0-21swapper/010:10:100
23342991815,2cyclictest94-21kswapd011:04:250
2334299180,18cyclictest0-21swapper/012:03:320
2335399175,8cyclictest13456-21apt-get12:10:123
2335199175,12cyclictest0-21swapper/211:03:472
23351991716,1cyclictest0-21swapper/210:04:092
23351991716,1cyclictest0-21swapper/207:32:242
2335199170,1cyclictest0-21swapper/211:50:382
2335199170,17cyclictest0-21swapper/210:52:082
2335199170,17cyclictest0-21swapper/210:40:502
2335199170,16cyclictest0-21swapper/212:27:202
23342991715,2cyclictest13-21ksoftirqd/010:40:390
2335399160,14cyclictest0-21swapper/311:33:233
2335199162,13cyclictest18799-21apt-get09:40:142
2335199160,16cyclictest0-21swapper/211:59:072
23346991615,1cyclictest25-21ksoftirqd/111:00:301
23346991614,1cyclictest0-21swapper/112:01:421
2334699160,16cyclictest0-21swapper/110:03:261
23342991616,0cyclictest0-21swapper/012:26:550
187262160,0sleep20-21swapper/212:31:492
2335399150,9cyclictest0-21swapper/311:35:133
2335199150,15cyclictest0-21swapper/209:16:342
2334699150,15cyclictest0-21swapper/109:05:001
2334299150,14cyclictest0-21swapper/012:17:110
2335399149,3cyclictest5357-21tr12:05:133
2335399148,3cyclictest12070-21ssh10:14:503
23353991410,3cyclictest4587-21sh12:05:003
23353991410,3cyclictest32429-21systemd11:04:243
23353991410,3cyclictest14256-21grep11:50:263
2335199140,14cyclictest0-21swapper/209:13:202
2335199140,13cyclictest0-21swapper/212:21:572
2335199140,13cyclictest0-21swapper/207:20:122
2335199140,12cyclictest0-21swapper/210:46:102
2334299140,14cyclictest0-21swapper/009:23:120
2334299140,10cyclictest0-21swapper/011:11:490
2335399139,3cyclictest31450-21tr10:45:143
2335399139,3cyclictest29998-21sed09:00:253
2335399139,3cyclictest22867-21tr10:40:143
2335399131,9cyclictest27029-21cstates11:20:153
23353991310,2cyclictest3425-21grep11:25:163
23353991310,2cyclictest31111-21sort07:30:253
23353991310,2cyclictest28245-21sed07:20:273
23353991310,2cyclictest15616-21sh12:30:163
23353991310,2cyclictest13926-21cron08:19:593
2335399130,13cyclictest0-21swapper/310:16:543
2335199139,3cyclictest2940-21sleep07:50:012
2335199135,4cyclictest225-21systemd-journal08:44:592
23351991311,1cyclictest32-21ksoftirqd/211:29:022
23351991310,2cyclictest30703-21chrt11:40:592
23351991310,2cyclictest30600-21cut10:25:192
23351991310,2cyclictest24732-21tr08:50:212
2335199130,2cyclictest0-21swapper/209:49:202
2335199130,12cyclictest27105-21tr08:55:222
2334699139,3cyclictest5966-21cat08:00:001
2334699139,3cyclictest23347-21wc08:50:001
23346991310,2cyclictest23512-21ssh11:56:021
23346991310,2cyclictest1200-21grep09:10:161
2334699130,1cyclictest0-21swapper/110:06:141
2334699130,13cyclictest0-21swapper/112:07:531
2334699130,12cyclictest0-21swapper/109:56:261
2334299131,6cyclictest3952-21rm09:11:170
2334299131,6cyclictest10691-21munin-run08:10:010
23342991312,1cyclictest0-21swapper/010:01:570
23342991311,1cyclictest28790-21head11:40:160
23342991310,2cyclictest6934-21wc12:05:250
23342991310,2cyclictest4837-21grep07:50:210
23342991310,2cyclictest30044-21wc10:05:260
23342991310,2cyclictest2331-21sed11:05:170
23342991310,2cyclictest2331-21sed11:05:170
2334299130,12cyclictest28538-21grep09:00:130
2335399129,2cyclictest31124-21ssh12:20:143
2335399129,2cyclictest30586-21cut10:25:193
2335399129,2cyclictest25696-21sh07:15:003
2335399129,2cyclictest14056-21ssh10:35:023
2335399129,2cyclictest10220-21ssh09:15:173
2335399123,4cyclictest225-21systemd-journal11:40:003
2335399122,6cyclictest16761-21sshd11:14:163
23353991210,1cyclictest23336-21cyclictest11:05:133
23353991210,1cyclictest23336-21cyclictest11:05:123
23353991210,1cyclictest0-21swapper/310:05:203
2335399120,1cyclictest0-21swapper/309:21:543
2335399120,12cyclictest0-21swapper/310:55:143
2335199129,2cyclictest8313-21sh08:05:012
2335199129,2cyclictest32754-21cron09:09:592
2335199129,2cyclictest22419-21awk08:45:182
2335199129,2cyclictest18186-21cut08:35:132
2335199129,2cyclictest13145-21wc08:15:212
2335199129,2cyclictest12986-21tail11:30:272
2335199128,3cyclictest30524-21head12:00:212
2335199123,6cyclictest23018-21apache209:30:552
23351991210,1cyclictest32-21ksoftirqd/212:12:592
2335199120,1cyclictest0-21swapper/210:55:522
2335199120,12cyclictest0-21swapper/209:28:342
2335199120,11cyclictest6918-21tail10:30:182
2334699129,2cyclictest9906-21tune2fs09:15:161
2334699129,2cyclictest9486-21chrt11:29:131
2334699129,2cyclictest4711-21grep11:45:161
2334699129,2cyclictest3477-21wc09:30:211
2334699129,2cyclictest28778-21fgrep09:45:261
2334699129,2cyclictest14158-21cut12:10:151
2334699129,2cyclictest13531-21grep10:15:171
2334699128,3cyclictest13928-21cron08:20:001
2334699128,2cyclictest0-21swapper/110:53:101
2334699127,4cyclictest18846-21ssh11:54:001
2334699123,9cyclictest0-21swapper/109:21:051
2334699123,6cyclictest10365-21ssh11:10:141
2334699122,8cyclictest4251-21sh11:06:021
2334699122,8cyclictest4251-21sh11:06:011
2334699122,2cyclictest452-21systemd-logind08:01:241
23346991211,1cyclictest0-21swapper/109:25:191
23346991211,0cyclictest0-21swapper/111:15:121
23346991210,1cyclictest31315-21grep12:20:151
2334699120,3cyclictest0-21swapper/110:44:471
2334699120,12cyclictest0-21swapper/110:34:331
2334699120,11cyclictest28424-21chrt10:24:251
2334299129,2cyclictest30983-21grep10:25:210
2334299129,2cyclictest24365-21head07:10:140
2334299129,2cyclictest23775-21tr08:50:140
2334299129,2cyclictest21468-21cut10:20:140
2334299129,2cyclictest19047-21ssh11:35:040
2334299129,2cyclictest14579-21grep10:35:140
2334299129,2cyclictest13473-21grep09:55:260
2334299129,2cyclictest12462-21ssh09:35:300
2334299129,2cyclictest12462-21ssh09:35:300
2334299126,2cyclictest225-21systemd-journal11:55:000
2334299121,7cyclictest26330-21munin-run07:20:000
23342991210,1cyclictest31498-21grep10:45:150
23342991210,1cyclictest27555-21grep08:55:270
23342991210,1cyclictest15933-21rm10:55:150
208792120,0sleep00-21swapper/011:15:580
2335399118,2cyclictest9329-21grep08:05:153
2335399118,2cyclictest7540-21ssh11:46:423
2335399118,2cyclictest5686-21ssh09:31:423
2335399118,2cyclictest563-21ssh09:29:143
2335399118,2cyclictest31915-21wc09:05:213
2335399118,2cyclictest27722-21chrt08:56:433
2335399118,2cyclictest27061-21ssh10:04:233
2335399118,2cyclictest25319-21chrt08:51:173
2335399118,2cyclictest2294-21grep09:10:233
2335399118,2cyclictest21757-21fw_packets08:45:133
2335399118,2cyclictest20468-21ssh11:55:063
2335399118,2cyclictest18758-21grep08:35:163
2335399118,2cyclictest16697-21chrt08:26:543
2335399118,2cyclictest11619-21sh09:55:143
2335399118,2cyclictest11291-21ssh10:33:143
2335399118,2cyclictest10472-21rm09:54:353
2335399118,2cyclictest10218-21ssh09:35:073
2335399118,2cyclictest10218-21ssh09:35:063
2335399117,2cyclictest20984-21wc08:45:003
2335399117,2cyclictest0-21swapper/312:35:123
2335399112,4cyclictest225-21systemd-journal08:00:013
2335199119,1cyclictest12938-21tr09:55:222
2335199118,2cyclictest3780-21cut07:50:122
2335199118,2cyclictest16752-21sh09:38:502
2335199118,2cyclictest16752-21sh09:38:492
2335199113,4cyclictest225-21systemd-journal08:15:012
2335199111,3cyclictest225-21systemd-journal07:29:592
2334699119,1cyclictest28296-21grep07:20:271
2334699119,1cyclictest15012-21ssh12:30:141
2334699118,2cyclictest6997-21sh09:51:511
2334699118,2cyclictest30542-21cut07:30:181
2334699118,2cyclictest30274-21ssh11:21:401
2334699118,2cyclictest27207-21grep08:55:241
2334699118,2cyclictest21235-21grep11:35:261
2334699118,2cyclictest16639-21sed10:55:201
2334699118,2cyclictest12500-21ssh09:35:321
2334699118,2cyclictest12500-21ssh09:35:321
2334699118,2cyclictest11051-21ssh11:30:131
2334699111,2cyclictest225-21systemd-journal07:19:591
23346991111,0cyclictest0-21swapper/109:40:151
2334299119,2cyclictest23008-21apache211:49:220
2334299119,1cyclictest6353-21grep10:30:150
2334299119,1cyclictest4870-21ssh09:50:240
2334299119,1cyclictest2780-21tr11:25:130
2334299119,1cyclictest21479-21sed11:55:150
2334299118,2cyclictest31786-21uname12:20:180
2334299118,2cyclictest28204-21ssh11:20:220
2334299118,2cyclictest21681-21grep08:45:120
2334299118,2cyclictest15147-21cat08:25:140
2334299118,2cyclictest14579-21dump-pmu-power08:24:590
2334299114,1cyclictest32346-21munin-run07:40:000
2334299114,1cyclictest32346-21munin-run07:39:590
2334299112,5cyclictest24735-21grep12:35:190
2334299111,6cyclictest225-21systemd-journal08:14:580
23342991110,1cyclictest0-21swapper/009:48:090
2334299110,2cyclictest0-21swapper/009:34:040
2335399108,1cyclictest32275-21chrt07:39:303
2335399108,1cyclictest32275-21chrt07:39:303
2335399108,1cyclictest29269-21chrt07:29:193
2335399108,1cyclictest2634-21chrt07:46:273
2335399108,1cyclictest26207-21taskset07:18:453
2335399108,1cyclictest13552sleep307:40:223
2335399108,1cyclictest109432sleep308:10:313
2335399107,2cyclictest17478-21taskset08:31:143
2335399101,5cyclictest225-21systemd-journal07:55:013
2335199108,1cyclictest56402sleep207:56:352
2335199108,1cyclictest0-21swapper/208:34:592
2335199107,2cyclictest8808-21grep08:05:132
2335199107,2cyclictest32354-21basename07:40:002
2335199107,2cyclictest32354-21basename07:40:002
2335199107,2cyclictest25544-21chrt07:13:172
2335199105,4cyclictest32-21ksoftirqd/207:40:202
2335199102,4cyclictest225-21systemd-journal09:00:162
2334699108,1cyclictest906-21grep07:40:161
2334699108,1cyclictest31039-21chrt10:45:091
2334699108,1cyclictest28162sleep107:48:491
2334699108,1cyclictest253362sleep107:10:351
2334699108,1cyclictest23896-21expr08:50:141
2334699108,1cyclictest14227-21taskset08:20:371
2334699108,1cyclictest10934-21seq08:10:241
2334699107,2cyclictest3597-21expr07:50:111
2334699107,2cyclictest32074-21chrt07:36:561
2334699107,2cyclictest32074-21chrt07:36:561
2334699107,2cyclictest32044-21sensors09:05:231
2334699107,2cyclictest20793-21sh08:45:001
2334699107,2cyclictest19878-21chrt08:36:341
2334699100,7cyclictest29337-21cron07:30:001
2334299109,1cyclictest537-21snmpd08:19:250
2334299108,2cyclictest31434-21chrt07:31:380
2334299108,2cyclictest15625-21rm12:30:170
2334299108,1cyclictest5638-21chrt07:56:340
2334299108,1cyclictest30709-21aten2_r7power_e09:05:140
2334299108,1cyclictest25918-21sh09:25:050
2334299107,2cyclictest7511-21expr10:50:140
2334299107,2cyclictest20347-21cut08:40:000
2334299107,2cyclictest11455-21sh09:15:370
2334299105,5cyclictest23018-21apache210:17:240
2334299100,9cyclictest6554-21expr08:00:150
2334299100,9cyclictest12401-21sh11:30:220
233539990,5cyclictest225-21systemd-journal08:25:003
233519997,1cyclictest26072-21sh07:17:002
233519997,1cyclictest143742sleep208:22:332
233469997,1cyclictest176942sleep108:34:011
233469997,1cyclictest15215-21expr08:25:151
233429998,1cyclictest27527-21uname07:20:200
233429998,1cyclictest20519-21chrt08:41:340
233429997,1cyclictest536-21expr07:40:140
233539986,1cyclictest6840-21grep08:00:163
233429987,1cyclictest17529-21chrt08:31:510
233429986,1cyclictest291802sleep007:28:130
233429976,1cyclictest2557-21taskset07:45:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional