You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-13 - 17:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot7s.osadl.org (updated Mon Apr 13, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3132029672,19sleep00-21swapper/007:07:050
3139428442,38sleep10-21swapper/107:08:031
2941528270,8sleep20-21swapper/207:05:072
3130328067,9sleep30-21swapper/307:06:533
188872680,0sleep00-21swapper/010:23:400
3163599300,1cyclictest0-21swapper/111:38:481
3163799290,27cyclictest0-21swapper/211:36:492
3163199270,1cyclictest0-21swapper/011:29:270
31631992623,2cyclictest13-21ksoftirqd/011:07:130
31637992521,4cyclictest32-21ksoftirqd/209:25:202
31635992423,1cyclictest0-21swapper/111:31:051
3164099230,3cyclictest24955-21ssh09:10:133
3163199237,10cyclictest0-21swapper/010:04:190
3163199230,2cyclictest0-21swapper/010:06:410
3163199230,1cyclictest0-21swapper/011:57:580
3163799220,22cyclictest0-21swapper/212:34:132
3163799220,22cyclictest0-21swapper/212:34:132
3163799220,1cyclictest0-21swapper/212:36:372
31640992118,2cyclictest39-21ksoftirqd/308:00:133
31640992117,3cyclictest0-21swapper/310:48:273
31637992117,4cyclictest0-21swapper/210:00:202
3163799210,21cyclictest0-21swapper/210:19:342
3163799210,18cyclictest0-21swapper/211:09:322
3163799210,16cyclictest0-21swapper/210:32:182
3163199212,2cyclictest141rcu_preempt09:28:420
3163199210,1cyclictest0-21swapper/011:17:540
3163199210,1cyclictest0-21swapper/011:11:160
3163199210,1cyclictest0-21swapper/011:03:000
3163799200,19cyclictest0-21swapper/210:55:012
3163799200,19cyclictest0-21swapper/209:20:272
3163799200,11cyclictest0-21swapper/209:55:182
31635992016,3cyclictest11769-21cron11:17:001
3163199200,2cyclictest0-21swapper/012:07:330
3163199200,1cyclictest0-21swapper/011:24:570
3163799190,1cyclictest0-21swapper/211:11:172
3163799190,18cyclictest0-21swapper/212:19:212
31635991919,0cyclictest0-21swapper/111:29:471
3163599190,19cyclictest0-21swapper/109:52:541
3163199190,13cyclictest0-21swapper/009:51:110
3163199190,0cyclictest0-21swapper/011:35:160
3163799183,14cyclictest0-21swapper/211:00:592
31637991817,1cyclictest0-21swapper/211:43:462
3163599182,1cyclictest0-21swapper/112:30:221
3163599182,1cyclictest0-21swapper/112:30:221
31635991817,1cyclictest0-21swapper/111:14:001
3163599180,16cyclictest0-21swapper/109:49:551
31631991817,1cyclictest0-21swapper/009:12:520
3163199180,2cyclictest0-21swapper/009:42:330
3163199180,1cyclictest0-21swapper/011:46:440
3163199180,1cyclictest0-21swapper/010:41:170
3163799173,12cyclictest0-21swapper/210:37:522
31637991716,1cyclictest0-21swapper/210:22:522
3163799171,15cyclictest0-21swapper/211:30:532
3163799170,1cyclictest0-21swapper/211:57:582
3163799170,14cyclictest0-21swapper/210:27:202
31635991715,1cyclictest0-21swapper/110:27:511
3163199171,6cyclictest225-21systemd-journal12:16:570
3163199170,3cyclictest0-21swapper/009:35:280
3163199170,3cyclictest0-21swapper/009:35:280
3163199170,17cyclictest0-21swapper/009:24:250
3163199170,15cyclictest0-21swapper/009:56:350
3163199170,0cyclictest0-21swapper/011:40:480
3164099160,1cyclictest0-21swapper/311:10:513
31637991615,1cyclictest0-21swapper/211:29:242
31637991613,1cyclictest0-21swapper/210:48:522
3163799160,9cyclictest0-21swapper/207:35:142
3163799160,1cyclictest0-21swapper/212:21:092
3163799160,1cyclictest0-21swapper/212:07:332
3163799160,1cyclictest0-21swapper/211:45:422
3163799160,14cyclictest0-21swapper/210:41:162
3163799160,14cyclictest0-21swapper/209:42:332
31635991616,0cyclictest0-21swapper/112:24:291
31635991615,1cyclictest0-21swapper/110:32:331
3163599161,2cyclictest0-21swapper/112:30:001
31635991612,3cyclictest0-21swapper/110:45:281
3163599161,14cyclictest13644-21ssh12:15:521
3163599160,1cyclictest0-21swapper/110:09:451
3163599160,15cyclictest0-21swapper/110:24:531
31631991615,1cyclictest0-21swapper/009:49:430
3163199160,15cyclictest0-21swapper/010:10:130
3164099157,6cyclictest537-21snmpd12:24:593
3164099151,13cyclictest0-21swapper/310:55:153
3163799157,6cyclictest19884-21systemctl12:00:212
3163799152,2cyclictest0-21swapper/209:48:552
31637991512,3cyclictest0-21swapper/207:25:132
3163799151,14cyclictest0-21swapper/211:22:482
3163799150,15cyclictest0-21swapper/210:05:172
31635991514,1cyclictest0-21swapper/111:45:141
31635991513,2cyclictest25-21ksoftirqd/112:35:291
3163599150,15cyclictest0-21swapper/109:58:371
3163199150,3cyclictest0-21swapper/012:14:140
3163199150,1cyclictest0-21swapper/012:02:520
3163199150,1cyclictest0-21swapper/011:51:120
3164099143,10cyclictest9201-21wc11:15:223
3164099141,7cyclictest19936-21apt-get09:00:123
31640991412,1cyclictest0-21swapper/310:20:223
3164099140,1cyclictest0-21swapper/311:51:113
3164099140,11cyclictest24420-21diskmemload10:11:553
3163799142,5cyclictest2701-21apt-get12:10:132
31637991411,2cyclictest28532-21apache_processe10:10:132
3163799140,4cyclictest0-21swapper/210:50:132
3163799140,13cyclictest0-21swapper/208:30:162
3163599149,4cyclictest27047-21wc12:05:131
3163599146,7cyclictest25-21ksoftirqd/112:04:071
31635991412,1cyclictest0-21swapper/112:14:491
31635991410,3cyclictest10564-21egrep08:40:141
31635991410,3cyclictest0-21swapper/111:42:341
3163599140,1cyclictest0-21swapper/109:44:451
3163599140,14cyclictest0-21swapper/110:52:361
3163599140,13cyclictest11979-21taskset09:20:541
3163199149,4cyclictest13-21ksoftirqd/008:35:200
31631991413,1cyclictest0-21swapper/009:17:010
3163199140,0cyclictest0-21swapper/012:36:380
3163199140,0cyclictest0-21swapper/010:19:570
3164099139,3cyclictest9550-21sh10:17:553
3164099139,3cyclictest6029-21grep12:30:273
3164099139,3cyclictest6029-21grep12:30:273
3164099139,3cyclictest26801-21basename09:50:013
3164099139,3cyclictest26677-21grep08:05:173
3164099139,2cyclictest1688-21cron09:35:003
3164099138,3cyclictest8255-21tr08:35:143
31640991312,1cyclictest0-21swapper/309:58:493
31640991310,2cyclictest27534-21tail12:05:163
31640991310,2cyclictest23002-21grep10:25:263
3164099130,1cyclictest0-21swapper/311:33:533
3163799131,1cyclictest0-21swapper/209:17:022
31637991311,1cyclictest0-21swapper/209:35:282
31637991311,1cyclictest0-21swapper/209:35:272
31637991310,2cyclictest23448-21tr09:05:212
3163799130,2cyclictest0-21swapper/211:51:132
3163799130,1cyclictest0-21swapper/211:17:542
3163799130,0cyclictest0-21swapper/209:12:032
3163599139,3cyclictest19276-21chrt10:04:411
3163599138,3cyclictest20199-21cat07:50:251
3163599131,11cyclictest55750irq/128-enp2s0-10:10:141
3163599130,4cyclictest0-21swapper/110:18:221
3163199134,7cyclictest24420-21diskmemload09:31:160
3163199134,3cyclictest225-21systemd-journal08:14:410
3163199133,7cyclictest0-21swapper/010:40:000
31631991310,2cyclictest13551-21sed08:45:150
3163199130,3cyclictest0-21swapper/012:24:530
3163199130,2cyclictest0-21swapper/011:31:590
3164099129,2cyclictest7695-21cron08:35:003
3164099129,2cyclictest3947-21munin-run07:20:003
3164099129,2cyclictest29369-21cat08:10:193
3164099129,2cyclictest28305-21tr12:25:143
3164099129,2cyclictest27712-21ssh11:26:133
3164099129,2cyclictest26408-21grep11:45:163
3164099129,2cyclictest21678-21df07:55:163
3164099129,2cyclictest20479-21grep10:05:153
3164099129,2cyclictest17010-21cut11:20:133
3164099129,2cyclictest15673-21sed07:40:253
3164099129,2cyclictest14330-21cat08:45:223
3164099129,2cyclictest11138-21head08:40:163
3164099129,2cyclictest10898-21sed07:30:263
3164099128,4cyclictest10464-21apache210:42:323
3164099128,3cyclictest8728-21basename07:30:003
3164099125,3cyclictest225-21systemd-journal10:04:593
3164099124,4cyclictest225-21systemd-journal10:35:003
3164099122,9cyclictest0-21swapper/309:19:403
3164099122,2cyclictest0-21swapper/312:10:313
31640991210,1cyclictest0-21swapper/311:39:063
3164099120,11cyclictest17099-21head07:45:173
3163799129,2cyclictest876-21cat07:10:252
3163799129,2cyclictest4931-21grep07:20:172
3163799129,2cyclictest3501-21grep08:25:142
3163799129,2cyclictest31587-21uname08:15:202
3163799129,2cyclictest29045-21ssh09:50:262
3163799129,2cyclictest15443-21tr08:50:162
3163799129,2cyclictest15425-21cat07:40:242
3163799129,2cyclictest1523-21grep08:20:152
31637991210,1cyclictest28537-21grep08:10:142
3163799120,10cyclictest0-21swapper/209:00:112
3163599129,2cyclictest8232-21tr08:35:141
3163599129,2cyclictest694-21wc07:10:221
3163599129,2cyclictest6296-21head10:35:181
3163599129,2cyclictest17944-21tr09:25:161
3163599129,2cyclictest1575-21head08:20:171
3163599129,2cyclictest15520-21sensors10:40:241
3163599128,2cyclictest20920-21wc09:00:181
3163599123,3cyclictest23428-21apt-get11:05:141
3163599121,7cyclictest225-21systemd-journal07:59:591
31635991212,0cyclictest0-21swapper/111:59:341
31635991210,2cyclictest38150irq/131-snd_hda09:16:101
3163199129,2cyclictest7709-21basename08:35:000
3163199129,2cyclictest6787-21grep10:55:160
3163199129,2cyclictest4978-21tail12:30:180
3163199129,2cyclictest4978-21tail12:30:170
3163199129,2cyclictest23058-21grep10:25:260
3163199129,2cyclictest20680-21sed09:00:160
3163199129,2cyclictest20076-21wc07:50:220
3163199129,2cyclictest10670-21grep08:40:140
3163199122,9cyclictest0-21swapper/008:55:150
31631991211,1cyclictest0-21swapper/010:46:520
3163199120,1cyclictest0-21swapper/010:54:270
3163199120,11cyclictest11396-21sed07:34:590
3163199120,11cyclictest0-21swapper/012:25:570
3164099118,2cyclictest6865-21sed10:35:233
3164099118,2cyclictest6807-21ssh09:37:293
3164099118,2cyclictest6807-21ssh09:37:283
3164099118,2cyclictest27122-21ssh09:50:063
3164099118,2cyclictest25232-21sh11:05:263
3164099118,2cyclictest22457-21grep09:05:153
3164099118,2cyclictest19666-21grep09:25:263
3164099118,2cyclictest17747-21ssh11:40:163
3164099118,2cyclictest15822-21head11:00:163
3164099118,2cyclictest13198-21ssh09:40:533
3164099118,2cyclictest10835-21ssh12:15:023
3164099118,2cyclictest10519-21df11:55:163
3164099117,3cyclictest13318-21grep12:35:163
3164099117,2cyclictest9397-21cut09:20:153
3164099115,2cyclictest225-21systemd-journal07:15:003
31640991110,1cyclictest20004-21smartctl12:00:233
3164099110,10cyclictest20299-21wc07:50:253
3163799119,2cyclictest20675-21taskset07:52:442
3163799118,2cyclictest9459-21grep07:30:142
3163799118,2cyclictest7962-21apache_accesses08:35:122
3163799118,2cyclictest19020-21cat08:55:272
3163799118,2cyclictest13018-21tr08:45:132
3163799113,2cyclictest0-21swapper/208:42:502
3163799110,6cyclictest0-21swapper/212:26:032
3163799110,2cyclictest17150-21gltestperf07:45:172
3163799110,1cyclictest0-21swapper/209:31:102
3163599118,2cyclictest9107-21ssh10:55:501
3163599118,2cyclictest5676-21chrt11:52:001
3163599118,2cyclictest4155-21sed09:35:261
3163599118,2cyclictest4155-21sed09:35:261
3163599118,2cyclictest3601-21chrt07:15:511
3163599118,2cyclictest28427-21taskset09:30:301
3163599118,2cyclictest27317-21ssh09:10:431
3163599118,2cyclictest17157-21head07:45:171
3163599118,2cyclictest16149-21ssh11:20:041
3163599118,2cyclictest14046-21tr07:40:141
3163599118,2cyclictest14011-21head08:45:191
3163599118,2cyclictest13717-21cron07:40:001
3163599118,2cyclictest11070-21taskset07:31:341
3163599117,3cyclictest6078-21taskset07:21:541
31635991110,1cyclictest31622-21cyclictest11:01:181
3163599110,11cyclictest0-21swapper/108:55:131
3163199118,2cyclictest588-21ntpq07:10:210
3163199118,2cyclictest4439-21sed08:25:210
3163199118,2cyclictest32230-21sh10:30:590
3163199118,2cyclictest31009-21expr08:15:160
3163199118,2cyclictest3060-21grep07:15:210
3163199118,2cyclictest26131-21tr08:05:140
3163199118,2cyclictest243302sleep009:09:020
3163199118,2cyclictest23792-21expr08:00:140
3163199118,2cyclictest23201-21chrt07:59:430
3163199118,2cyclictest17453-21sed07:45:200
3163199118,2cyclictest16625-21sed08:50:260
3163199118,2cyclictest159842sleep007:43:280
3163199111,5cyclictest0-21swapper/007:35:140
3164099108,1cyclictest856-21aten2_r7power_c08:20:133
3164099108,1cyclictest4618-21sh08:25:253
3164099108,1cyclictest31912-21ntpq10:50:203
3164099108,1cyclictest18549-21cat08:55:203
3164099108,1cyclictest15121-21chrt08:50:023
3164099108,1cyclictest115762sleep307:35:053
3164099107,2cyclictest31432-21grep08:15:183
3163799109,1cyclictest2308-21sh07:15:142
3163799108,1cyclictest25187-21sed08:00:262
3163799107,2cyclictest22285-21runrttasks07:55:212
3163799102,4cyclictest0-21swapper/208:05:132
3163599108,1cyclictest65572sleep107:25:061
3163599108,1cyclictest31722-21sed08:15:201
3163599108,1cyclictest30132-21taskset08:11:571
3163599107,2cyclictest5657-21cut08:30:161
3163599107,2cyclictest4074-21mii-tool08:25:171
3163599107,2cyclictest24124-21cut08:00:161
3163599107,2cyclictest15442-21grep08:50:161
3163199107,2cyclictest8346-21chrt07:25:330
3163199107,2cyclictest6188-21chrt07:23:200
3163199101,5cyclictest225-21systemd-journal08:25:000
316409997,1cyclictest4201-21acpi07:20:113
316359996,2cyclictest25948-21cut08:05:141
316359996,2cyclictest22334-21cut09:05:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional