You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-11 - 18:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Sun Jan 11, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24460210075,19sleep00-21swapper/007:05:200
2550929982,13sleep20-21swapper/207:06:522
2548829065,6sleep10-21swapper/107:06:341
2547328661,9sleep30-21swapper/307:06:253
315572690,0sleep30-21swapper/312:29:163
25842994118,22cyclictest0-21swapper/211:05:132
2583999270,26cyclictest0-21swapper/112:04:571
25839992523,1cyclictest18809-21diskmemload12:29:151
2583999250,1cyclictest0-21swapper/109:57:451
186952250,0chrt0-21swapper/309:28:333
268822240,0chrt0-21swapper/010:10:320
25846992424,0cyclictest0-21swapper/307:11:593
2584699240,1cyclictest0-21swapper/310:39:513
25846992322,1cyclictest0-21swapper/309:57:453
2584299230,20cyclictest0-21swapper/212:35:212
2583999230,21cyclictest0-21swapper/109:44:401
2584699220,22cyclictest0-21swapper/311:50:233
2583999220,1cyclictest18809-21diskmemload12:30:371
2584699210,20cyclictest0-21swapper/309:16:303
2584699210,1cyclictest0-21swapper/311:06:563
2583999217,13cyclictest18809-21diskmemload10:20:571
2583999210,1cyclictest0-21swapper/112:16:391
2583999210,19cyclictest0-21swapper/110:38:341
2583699210,0cyclictest0-21swapper/007:55:140
2584699200,1cyclictest0-21swapper/309:13:023
2584299200,20cyclictest0-21swapper/212:20:232
2584299200,18cyclictest0-21swapper/207:10:172
2583999200,19cyclictest0-21swapper/111:04:491
2583999200,0cyclictest0-21swapper/110:02:061
25846991918,1cyclictest0-21swapper/309:44:403
25842991918,1cyclictest0-21swapper/208:15:132
2583999191,0cyclictest0-21swapper/111:32:281
2583999190,2cyclictest0-21swapper/109:36:151
2583999190,18cyclictest0-21swapper/112:05:351
2583699197,6cyclictest7181-21munin-run10:00:000
2584299185,2cyclictest1142-21runrttasks12:17:512
25842991814,4cyclictest31185-21kworker/u8:010:48:232
2583999180,3cyclictest26470-21wc10:10:261
2583999180,1cyclictest0-21swapper/110:40:591
2583999180,17cyclictest0-21swapper/109:29:451
25836991817,1cyclictest0-21swapper/009:52:020
25846991716,1cyclictest0-21swapper/309:36:163
2584699171,2cyclictest0-21swapper/310:02:483
2584699171,1cyclictest0-21swapper/311:25:133
2584699170,1cyclictest0-21swapper/309:33:293
25842991714,2cyclictest10469-21kworker/u8:112:30:352
2584699168,2cyclictest23823-21hddtemp_smartct09:50:173
2584699168,0cyclictest18809-21diskmemload09:21:043
2584699165,9cyclictest20066-21apt-get08:05:143
25846991615,1cyclictest0-21swapper/311:23:153
2584699160,1cyclictest0-21swapper/311:55:053
2584299162,10cyclictest30029-21munin-plugin-st11:30:002
25839991613,2cyclictest22281-21mailstats11:05:241
25839991612,3cyclictest18809-21diskmemload11:52:461
2583999160,13cyclictest0-21swapper/107:10:171
2583699169,6cyclictest1370-21apache211:13:060
2583699160,2cyclictest0-21swapper/011:58:400
2584699153,11cyclictest520-21gmain12:24:473
2584699152,11cyclictest17211-21interrupts10:05:183
2584699151,14cyclictest0-21swapper/312:00:433
2584699150,14cyclictest14117-21ssh12:37:413
2584299156,4cyclictest0-21swapper/210:16:462
2584299150,1cyclictest0-21swapper/211:43:572
2583999159,5cyclictest0-21swapper/109:23:421
2583999152,12cyclictest19318-21sensors10:25:261
2583999150,0cyclictest0-21swapper/112:10:381
2583699158,6cyclictest28199-21perf07:15:010
2583699151,2cyclictest0-21swapper/009:40:130
2584699144,6cyclictest16260-21kworker/3:011:32:383
2584699142,8cyclictest17172-21awk10:24:593
25846991412,1cyclictest0-21swapper/312:30:063
2584699140,14cyclictest0-21swapper/311:01:423
2584299149,3cyclictest0-21swapper/211:51:292
2584299142,2cyclictest9823-21ssh09:23:152
25842991413,1cyclictest311rcuc/211:30:242
25842991410,3cyclictest8407-21sed11:35:252
25842991410,3cyclictest16899-21grep09:05:142
2583999149,4cyclictest14983-21cut11:40:121
2583999146,3cyclictest31938-21kworker/1:111:13:491
2583999145,6cyclictest475-21in:imuxsock07:49:261
2583999142,11cyclictest25422-21ssh11:45:261
2583999142,11cyclictest18809-21diskmemload12:24:181
25839991412,2cyclictest0-21swapper/111:37:341
2583999140,2cyclictest0-21swapper/111:59:571
2583699149,3cyclictest16774-21grep12:00:140
25836991410,3cyclictest8898-21wc10:00:200
25836991410,3cyclictest26114-21tr08:15:220
25836991410,3cyclictest11977-21grep07:45:270
25836991410,2cyclictest29532-21cat08:25:000
2583699140,4cyclictest0-21swapper/010:42:510
2583699140,1cyclictest0-21swapper/010:15:150
25846991310,2cyclictest775-21dpkg10:15:133
25846991310,2cyclictest31052-21grep11:10:263
25846991310,2cyclictest30785-21sed07:20:013
25846991310,2cyclictest18212-21head08:00:183
25846991310,1cyclictest0-21swapper/312:08:123
2584299139,3cyclictest31960-21grep09:55:162
2584299138,4cyclictest24135-21chrt09:12:332
2584299136,5cyclictest311rcuc/210:10:462
2584299136,3cyclictest22077-21apache210:35:112
2584299133,3cyclictest12201-21apache_processe11:00:142
25842991310,2cyclictest7167-21grep07:35:312
25842991310,2cyclictest32751-21cron12:10:002
25842991310,2cyclictest27007-21tail10:30:152
2584299130,4cyclictest0-21swapper/210:03:362
2584299130,12cyclictest0-21swapper/211:12:372
2583999139,3cyclictest28095-21sed10:30:251
2583999138,5cyclictest38150irq/131-snd_hda08:05:201
2583999136,1cyclictest18809-21diskmemload09:12:401
2583999131,7cyclictest18809-21diskmemload09:33:151
2583699139,3cyclictest30081-21grep07:15:310
2583699139,3cyclictest29138-21sh09:35:000
2583699139,3cyclictest12348-21ssh11:00:150
2583699136,3cyclictest1857-21irqstats12:10:170
2583699132,3cyclictest0-21swapper/012:05:240
2583699132,3cyclictest0-21swapper/009:16:460
2583699131,5cyclictest0-21swapper/008:40:130
25836991310,2cyclictest7796-21tr11:35:200
25836991310,2cyclictest7358-21cat11:54:590
25836991310,2cyclictest31752-21cron08:29:590
25836991310,2cyclictest21378-21vmstat09:10:270
25836991310,2cyclictest19472-21ssh09:29:080
25836991310,2cyclictest11675-21munin-run11:00:000
2583699130,13cyclictest0-21swapper/010:39:230
301702120,1sleep00-21swapper/010:31:570
2584699129,2cyclictest3603-21grep08:35:273
2584699129,2cyclictest320-21grep08:30:173
2584699129,2cyclictest31359-21sed08:25:303
2584699129,2cyclictest22723-21grep08:10:133
2584699129,2cyclictest12042-21sed07:45:263
2584699124,5cyclictest26298-21aten2_r7power_e10:30:123
2584699124,5cyclictest18809-21diskmemload11:15:303
2584699124,5cyclictest18809-21diskmemload11:15:303
25846991211,1cyclictest0-21swapper/311:49:473
25846991210,1cyclictest6805-21grep11:35:143
25846991210,1cyclictest29700-21grep10:50:283
25846991210,1cyclictest18809-21diskmemload12:19:273
25846991210,1cyclictest18809-21diskmemload12:10:593
25846991210,1cyclictest15157-21cut09:45:173
2584699120,11cyclictest17246-21sed09:05:153
2584299129,2cyclictest31354-21sed08:25:292
2584299129,2cyclictest30884-21grep07:20:122
2584299129,2cyclictest28191-21tr09:15:152
2584299129,2cyclictest27879-21cut08:20:192
2584299129,2cyclictest16804-21grep12:00:142
2584299129,2cyclictest105372sleep210:20:202
2584299128,3cyclictest1583-21cut07:25:172
2584299128,3cyclictest13400-21grep09:25:162
2584299127,4cyclictest24244-21ntp_states09:50:212
2584299121,4cyclictest225-21systemd-journal09:40:012
25842991210,1cyclictest4658-21tr08:40:142
2583999129,2cyclictest5807-21grep07:35:201
2583999129,2cyclictest29117-21head10:50:241
2583999129,2cyclictest15282-21wc09:00:191
2583999129,2cyclictest14857-21grep11:20:201
2583999123,3cyclictest225-21systemd-journal12:36:441
2583999120,1cyclictest0-21swapper/110:18:061
2583999120,12cyclictest0-21swapper/111:19:081
2583999120,12cyclictest0-21swapper/111:19:071
2583999120,11cyclictest1407-21sh09:18:301
2583699129,2cyclictest8230-21grep07:40:140
2583699129,2cyclictest32307-21ssh12:29:510
2583699129,2cyclictest23704-21tr11:45:120
2583699129,2cyclictest21399-21tune2fs11:05:180
2583699129,2cyclictest13867-21ssh11:20:130
2583699128,3cyclictest6329-21grep07:35:220
2583699128,3cyclictest14568-21grep09:00:150
2583699128,3cyclictest11419-21ssh10:20:340
2583699128,2cyclictest21085-21grep10:45:270
2583699127,3cyclictest18523-21tail10:25:190
2583699127,2cyclictest24033-21ssh11:25:270
2583699127,2cyclictest225-21systemd-journal07:30:000
2583699126,2cyclictest1720-21ls08:35:000
2583699120,1cyclictest0-21swapper/009:37:240
2583699120,12cyclictest0-21swapper/011:18:270
2583699120,12cyclictest0-21swapper/011:18:260
286872110,0sleep20-21swapper/209:34:402
2584699119,1cyclictest4794-21grep07:30:273
2584699119,1cyclictest12145-21tr10:40:213
2584699119,1cyclictest11652-21cron08:55:003
2584699118,2cyclictest6868-21gzip07:35:273
2584699118,2cyclictest4858-21tr08:40:153
2584699118,2cyclictest29518-21ssh10:12:363
2584699118,2cyclictest26525-21sed08:15:283
2584699118,2cyclictest22195-21sh10:27:203
2584699118,2cyclictest13801-21strings07:50:203
2584699114,4cyclictest18809-21diskmemload10:56:093
25846991110,1cyclictest16260-21kworker/3:011:42:233
2584299119,1cyclictest14044-21expr11:20:152
2584299118,2cyclictest9248-21ssh09:41:262
2584299118,2cyclictest7933-21cut11:55:152
2584299118,2cyclictest5146-21ssh11:15:142
2584299118,2cyclictest5146-21ssh11:15:132
2584299118,2cyclictest454-21taskset10:52:562
2584299118,2cyclictest32591-21cut12:30:002
2584299118,2cyclictest19377-21wc10:25:282
2584299118,2cyclictest14226-21ssh09:45:052
2584299118,2cyclictest12839-21ssh10:40:302
2584299118,2cyclictest1283-21cat12:10:122
2584299118,2cyclictest10977-21ssh10:59:292
2584299110,11cyclictest0-21swapper/210:07:432
2583999119,2cyclictest22399-21tr11:25:141
2583999119,1cyclictest4523-21grep10:55:161
2583999119,1cyclictest1913-21cut07:25:201
2583999119,1cyclictest16103-21wc09:45:261
2583999118,2cyclictest8602-21grep07:40:161
2583999118,2cyclictest7664-21grep08:45:171
2583999118,2cyclictest32074-21head07:20:211
2583999118,2cyclictest30239-21sh09:54:301
2583999118,2cyclictest29946-21sort07:15:301
2583999118,2cyclictest2688-21tail08:35:171
2583999118,2cyclictest21463-21sh10:07:561
2583999118,2cyclictest18453-21chrt09:05:341
2583999118,2cyclictest10030-21sh08:50:151
25839991110,1cyclictest38150irq/131-snd_hda10:45:121
2583999110,10cyclictest272382sleep108:20:071
2583699118,2cyclictest8780-21chrt08:46:260
2583699118,2cyclictest6497-21ssh12:33:180
2583699118,2cyclictest3916-21ssh09:20:030
2583699118,2cyclictest3912-21grep07:30:180
2583699118,2cyclictest28385-21grep10:50:180
2583699118,2cyclictest19584-21ssh12:21:330
2583699118,2cyclictest19299-21ssh10:06:160
2583699118,2cyclictest18478-21cat08:00:200
2583699118,2cyclictest18357-21ssh09:46:550
2583699118,2cyclictest16837-21grep11:40:250
2583699118,2cyclictest14617-21chrt07:52:400
2583699118,2cyclictest12702-21ssh12:17:560
2583699118,2cyclictest10739-21grep12:35:230
2583699113,7cyclictest3876-21sshd08:37:270
2584699108,2cyclictest8418-21expr07:40:163
2584699108,1cyclictest7696-21expr08:45:173
2584699108,1cyclictest27625-21expr08:20:163
2584699108,1cyclictest12362-21cat08:55:143
2584699108,1cyclictest1229-21expr07:25:153
2584699107,2cyclictest21108-21sed10:45:273
2584699107,2cyclictest16570-21cat07:55:273
2584699107,2cyclictest14447-21aten2_r7power_v09:00:153
2584299108,1cyclictest98652sleep207:42:422
2584299108,1cyclictest8939-21chrt08:48:282
2584299108,1cyclictest29651-21taskset07:15:272
2584299108,1cyclictest22693-21tr08:10:132
2584299108,1cyclictest14700-21taskset07:53:462
2584299108,1cyclictest0-21swapper/209:00:282
2584299107,2cyclictest3626-21expr07:30:162
2584299107,2cyclictest3195-21ls08:35:222
2584299107,2cyclictest1635-21chrt08:34:102
2584299107,2cyclictest13538-21grep08:55:262
2584299103,3cyclictest23420-21apt-get11:45:122
2584299100,9cyclictest19955-21apt-config08:05:022
2583999109,1cyclictest0-21swapper/107:30:141
2583999108,1cyclictest5460-21chrt08:40:181
2583999108,1cyclictest23272-21cut08:10:171
2583999108,1cyclictest18279-21sed08:00:181
2583999108,1cyclictest16618-21wc07:55:271
2583999108,1cyclictest12414-21df08:55:151
2583999102,4cyclictest225-21systemd-journal08:33:061
2583699108,1cyclictest32446-21unixbench_singl11:30:250
2583699108,1cyclictest31798-21cut07:20:180
2583699108,1cyclictest18639-21taskset09:08:010
2583699108,1cyclictest13731-21taskset08:56:160
2583699108,1cyclictest114552sleep008:52:300
2583699106,3cyclictest22735-21grep08:10:140
2583699100,9cyclictest21991-21chrt08:07:510
258469992,4cyclictest30554-21cron07:20:003
258429997,1cyclictest9507-21taskset08:50:032
258429997,1cyclictest18238-21head08:00:182
258429997,1cyclictest150322sleep207:55:042
258429997,1cyclictest12231-21taskset07:47:362
258399997,1cyclictest31051-21chrt08:25:271
258399997,1cyclictest25193-21expr08:15:151
258399996,2cyclictest13838-21tr07:50:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional