You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 12:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Thu Sep 03, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2221029767,9sleep20-21swapper/219:08:222
2204229243,44sleep10-21swapper/119:06:121
2206828860,9sleep00-21swapper/019:06:310
2215527764,9sleep30-21swapper/319:07:383
296042680,1sleep229600-21idleruntime-cro19:25:002
306352610,0sleep10-21swapper/100:12:021
2242599337,25cyclictest15438-21diskmemload22:12:502
22425993126,4cyclictest32621-21ssh21:20:072
22425993121,9cyclictest4953-21ntpq22:20:192
2242599310,30cyclictest15438-21diskmemload22:35:012
2242599301,28cyclictest15438-21diskmemload21:19:112
2242599301,27cyclictest484-21NetworkManager00:07:582
2242599300,30cyclictest0-21swapper/221:33:462
2242599300,29cyclictest15438-21diskmemload23:36:102
2242599295,23cyclictest1-21systemd22:05:232
2242299290,4cyclictest0-21swapper/123:55:221
2242599282,25cyclictest2836-21/usr/sbin/munin21:40:232
2242599280,27cyclictest0-21swapper/219:35:052
2242599270,27cyclictest15438-21diskmemload23:28:012
2242599270,26cyclictest0-21swapper/222:42:402
2242599270,25cyclictest15438-21diskmemload22:32:032
323452260,1sleep30-21swapper/323:54:283
2242599262,23cyclictest15438-21diskmemload21:56:502
2242599260,25cyclictest0-21swapper/223:45:302
2242599260,25cyclictest0-21swapper/222:55:492
2242599260,24cyclictest0-21swapper/220:35:142
2242299261,3cyclictest0-21swapper/122:20:191
2242299260,3cyclictest0-21swapper/121:17:291
2242599255,18cyclictest22340-21ssh22:50:162
2242599250,24cyclictest0-21swapper/200:24:502
2242299254,2cyclictest225-21systemd-journal00:07:581
2242299251,2cyclictest141rcu_preempt21:51:131
2242299251,2cyclictest141rcu_preempt21:51:121
2242599242,19cyclictest9233-21tune2fs23:40:162
2242599241,22cyclictest15438-21diskmemload23:56:562
2242599241,21cyclictest15438-21diskmemload21:48:562
2242599240,22cyclictest0-21swapper/222:28:592
2242599240,22cyclictest0-21swapper/221:27:502
2242299242,1cyclictest15438-21diskmemload21:45:251
22428992323,0cyclictest0-21swapper/322:22:093
2242599236,16cyclictest15438-21diskmemload00:18:412
2242599233,19cyclictest23563-21df_inode23:10:202
2242599232,19cyclictest0-21swapper/200:04:302
2242599230,22cyclictest0-21swapper/223:02:432
2242599230,21cyclictest0-21swapper/219:40:132
2242599230,20cyclictest15438-21diskmemload21:53:432
2242599230,20cyclictest15438-21diskmemload21:53:432
2242599230,20cyclictest0-21swapper/222:01:082
2242299232,2cyclictest15438-21diskmemload23:22:251
2242899220,3cyclictest0-21swapper/300:30:143
2242599221,18cyclictest15438-21diskmemload00:32:562
2242599220,22cyclictest0-21swapper/221:12:432
2242599220,21cyclictest0-21swapper/220:15:132
2242599220,21cyclictest0-21swapper/200:25:192
2242599220,17cyclictest0-21swapper/220:30:122
2242299223,2cyclictest15438-21diskmemload21:55:061
2242299220,3cyclictest0-21swapper/122:00:161
2242599211,19cyclictest15438-21diskmemload23:05:392
2242599211,16cyclictest455-21dbus-daemon21:05:222
2242599210,21cyclictest0-21swapper/200:12:112
2242599210,16cyclictest0-21swapper/223:51:062
2242299214,13cyclictest22095-21kworker/1:019:45:171
2242299210,5cyclictest0-21swapper/121:20:141
2242299210,3cyclictest0-21swapper/122:56:181
2242299210,1cyclictest0-21swapper/122:41:061
2242899208,10cyclictest15438-21diskmemload21:19:453
2242899200,20cyclictest0-21swapper/322:37:503
2242599201,18cyclictest14160-21wc20:00:002
2242599201,15cyclictest15438-21diskmemload23:20:082
2242599200,19cyclictest0-21swapper/223:18:172
2242599200,19cyclictest0-21swapper/221:39:082
2242599200,19cyclictest0-21swapper/219:10:132
2242599200,17cyclictest0-21swapper/222:16:492
2242599200,15cyclictest0-21swapper/223:30:482
2242299206,3cyclictest15438-21diskmemload23:16:251
2242299201,1cyclictest0-21swapper/120:50:131
2242299200,2cyclictest0-21swapper/100:25:021
2241899204,9cyclictest3288-21ssh23:36:220
2242299190,18cyclictest0-21swapper/121:35:261
2242599180,17cyclictest8359-21latency_hist20:55:002
2242299183,1cyclictest0-21swapper/122:08:451
2242299181,2cyclictest0-21swapper/122:18:021
2242299180,2cyclictest0-21swapper/100:36:061
2242299180,17cyclictest0-21swapper/122:34:201
2242899173,12cyclictest0-21swapper/323:40:123
2242899170,1cyclictest0-21swapper/300:06:053
2242899170,17cyclictest0-21swapper/322:47:213
2242599176,8cyclictest1884-21taskset19:34:342
2242599172,14cyclictest4612-21ssh00:35:192
2242599172,13cyclictest15438-21diskmemload22:45:082
2242599170,16cyclictest0-21swapper/220:55:142
2242299172,2cyclictest0-21swapper/123:44:191
22422991710,6cyclictest14698-21grep22:45:221
2242299170,9cyclictest0-21swapper/123:48:311
2242299170,4cyclictest0-21swapper/100:17:211
2242299170,3cyclictest0-21swapper/122:35:141
2242299170,1cyclictest0-21swapper/121:25:311
2242299170,17cyclictest0-21swapper/123:04:251
2242299170,17cyclictest0-21swapper/122:53:101
2241899174,7cyclictest18753-21munin-run00:25:000
22418991713,4cyclictest25319-21apache223:08:470
2241899170,2cyclictest0-21swapper/023:27:270
2242899161,12cyclictest16834-21hddtemp_smartct21:10:173
2242599168,7cyclictest11746-21cat19:55:002
2242599160,15cyclictest0-21swapper/219:20:002
2242299169,6cyclictest29108-21grep19:20:261
2242299168,7cyclictest17725-21wc20:05:241
2242299168,7cyclictest17725-21wc20:05:241
2242299168,6cyclictest30641-21head19:25:161
2242299163,12cyclictest25319-21apache223:12:451
2242299160,2cyclictest15438-21diskmemload22:25:181
2242299160,0cyclictest0-21swapper/123:35:101
2242299160,0cyclictest0-21swapper/123:07:011
22418991614,1cyclictest15438-21diskmemload21:54:140
22418991614,1cyclictest15438-21diskmemload21:54:140
22428991515,0cyclictest0-21swapper/321:54:303
22428991515,0cyclictest0-21swapper/321:54:303
2242899150,12cyclictest0-21swapper/323:55:133
2242599158,6cyclictest4059-21expr20:45:142
2242599158,6cyclictest16141-21chrt20:01:262
2242599150,14cyclictest0-21swapper/220:40:162
2242599150,14cyclictest0-21swapper/220:20:152
2242299159,5cyclictest16498-21wc20:05:001
2242299158,6cyclictest32507-21cut19:30:141
2242299158,6cyclictest25003-21cat21:35:001
2242299158,6cyclictest23446-21which19:10:171
2242299158,6cyclictest20945-21ssh22:10:281
2242299158,6cyclictest19147-21sed20:10:011
2242299151,2cyclictest0-21swapper/120:20:131
22422991511,4cyclictest0-21swapper/100:32:021
2242299150,14cyclictest29655-21df20:30:151
22418991514,1cyclictest0-21swapper/022:27:280
22418991510,5cyclictest25310-21apache222:57:480
2241899150,1cyclictest0-21swapper/021:39:560
22428991411,2cyclictest8285-21munin-plugin-st20:54:593
22428991411,2cyclictest13045-21head22:25:153
22428991410,2cyclictest13056-21awk21:05:003
2242599148,5cyclictest31015-21ntp_offset19:25:202
2242599147,6cyclictest20423-21cat20:10:182
2242599146,7cyclictest7913-21grep19:45:192
2242599146,7cyclictest28827-21munin-run20:30:002
2242599140,12cyclictest0-21swapper/220:05:192
2242599140,12cyclictest0-21swapper/220:05:192
2242299148,5cyclictest31176-21ssh23:53:341
2242299148,5cyclictest24652-21df23:30:161
2242299147,6cyclictest25095-21cut19:15:131
2242299147,6cyclictest22739-21cat20:15:191
2242299147,6cyclictest15511-21ssh23:25:071
2242299147,6cyclictest12785-21tail00:20:241
2242299147,6cyclictest12157-21tr19:55:151
2242299146,2cyclictest4995-21ls20:45:201
2242299144,2cyclictest225-21systemd-journal20:36:151
2242299143,6cyclictest10711-21sshd19:50:211
2242299143,10cyclictest15959-21apt-get21:10:131
2242299142,2cyclictest225-21systemd-journal19:40:001
2241899140,8cyclictest26468-21perf20:25:000
2242899139,3cyclictest378-21sort19:30:153
2242899139,3cyclictest1772-21grep21:20:233
2242899138,3cyclictest23302-21sed20:15:263
2242899138,3cyclictest22878-21/usr/sbin/munin23:10:333
2242899136,5cyclictest6682-21diskstats23:00:153
22428991313,0cyclictest0-21swapper/321:33:513
22428991311,1cyclictest0-21swapper/322:32:423
22428991310,2cyclictest31322-21grep23:15:123
22428991310,2cyclictest23560-21ssh23:30:003
22428991310,2cyclictest23103-21chrt23:48:463
2242899130,12cyclictest15013-21sed21:05:263
2242899130,11cyclictest0-21swapper/300:24:453
2242599131,11cyclictest0-21swapper/221:00:212
2242299137,5cyclictest9865-21expr00:00:121
2242299136,2cyclictest5270-21ssh21:41:581
2242299136,2cyclictest14456-21ntpq21:05:191
2242299130,4cyclictest225-21systemd-journal20:41:161
2242299130,4cyclictest225-21systemd-journal19:45:001
2242299130,4cyclictest12996-21sshd21:04:241
2241899139,3cyclictest31982-21grep23:15:140
2241899139,3cyclictest28861-21cat00:30:200
2241899139,3cyclictest24731-21wc23:10:310
2241899132,9cyclictest6197-21python19:40:250
2241899132,6cyclictest5914-21munin-run20:50:000
22418991311,1cyclictest0-21swapper/022:15:120
22418991310,2cyclictest8824-21sed19:45:280
22418991310,2cyclictest32205-21cron21:20:000
22418991310,2cyclictest27220-21df00:10:160
22418991310,2cyclictest24150-21ssh00:08:360
22418991310,2cyclictest19951-21grep20:10:150
22418991310,2cyclictest17677-21cat21:50:000
22418991310,2cyclictest10837-21ssh00:00:210
2242899129,2cyclictest4957-21basename22:40:133
2242899129,2cyclictest3206-21basename22:20:013
2242899129,2cyclictest29740-21cat22:55:003
2242899129,2cyclictest27176-21grep21:55:173
2242899129,2cyclictest26426-21taskset00:10:063
2242899129,2cyclictest2181-21grep21:40:173
2242899129,2cyclictest10899-21nfs4_client21:45:193
2242899128,3cyclictest9883-21ssh22:04:483
2242899128,3cyclictest32546-21tail20:35:203
2242899128,3cyclictest26447-21latency_hist20:25:003
2242899126,3cyclictest225-21systemd-journal22:06:043
2242899126,2cyclictest225-21systemd-journal23:09:593
2242899125,2cyclictest225-21systemd-journal20:48:043
2242899120,1cyclictest141rcu_preempt22:14:433
2242899120,1cyclictest0-21swapper/323:30:503
2242899120,1cyclictest0-21swapper/300:25:063
2242899120,11cyclictest32125-21wc19:30:003
2242299129,2cyclictest9309-21grep20:55:151
2242299120,4cyclictest28017-21rt-features20:25:201
2241899129,2cyclictest8954-21awk00:00:000
2241899129,2cyclictest7904-21grep23:00:240
2241899129,2cyclictest29713-21wc19:25:000
2241899129,2cyclictest25374-21cut19:15:140
2241899129,2cyclictest16967-21aten2_r7power_v23:45:140
2241899129,2cyclictest1608-21grep21:40:150
2241899129,2cyclictest12601-21grep21:00:270
2241899129,2cyclictest10675-21awk21:00:000
2241899129,2cyclictest10518-21sed21:25:260
2241899124,2cyclictest225-21systemd-journal22:45:000
2241899122,8cyclictest24061-21runrttasks21:34:230
22418991211,1cyclictest0-21swapper/000:25:140
2241899120,4cyclictest225-21systemd-journal20:35:010
2241899120,3cyclictest0-21swapper/022:01:340
2242899118,2cyclictest8518-21ssh21:25:083
2242899118,2cyclictest7494-21ssh00:17:453
2242899118,2cyclictest6407-21grep19:40:263
2242899118,2cyclictest340-21grep23:35:153
2242899118,2cyclictest3316-21ssh00:35:013
2242899118,2cyclictest30703-21grep20:30:253
2242899118,2cyclictest27004-21taskset19:17:303
2242899118,2cyclictest25973-21sed21:35:163
2242899118,2cyclictest16186-21taskset20:02:023
2242899118,2cyclictest1374-21ssh22:56:453
2242899118,2cyclictest12570-21grep19:55:173
2242899118,2cyclictest10295-21taskset20:55:283
2242899118,2cyclictest10026-21ssh23:21:013
2241899119,2cyclictest6631-21ssh00:17:030
2241899119,1cyclictest3659-21apache_processe22:20:110
2241899118,2cyclictest9882-21grep23:40:220
2241899118,2cyclictest864-21expr21:20:170
2241899118,2cyclictest8399-21cat23:20:210
2241899118,2cyclictest3166-21head19:35:160
2241899118,2cyclictest2942-21wc20:40:260
2241899118,2cyclictest28823-21ssh22:35:050
2241899118,2cyclictest27573-21uname21:55:200
2241899118,2cyclictest25625-21ssh22:51:550
2241899118,2cyclictest25011-21ssh23:50:080
2241899118,2cyclictest21850-21tr20:15:140
2241899118,2cyclictest21419-21gltestperf22:30:160
2241899118,2cyclictest20751-21grep22:10:260
2241899118,2cyclictest16249-21tr21:10:150
2241899118,2cyclictest15598-21ssh22:07:340
2241899118,2cyclictest14914-21sort20:00:160
2241899118,2cyclictest1428-21sed19:30:250
2241899118,2cyclictest13920-21sort21:05:160
2241899118,2cyclictest12856-21uname19:55:190
2241899115,3cyclictest0-21swapper/019:25:130
2241899110,10cyclictest0-21swapper/022:49:150
2242899108,1cyclictest8490-21gzip19:45:243
2242899108,1cyclictest27626-21cut19:20:143
2242899108,1cyclictest19177-21touch20:10:013
2242899108,1cyclictest1617-21egrep20:40:143
2242899107,2cyclictest9425-21sh00:00:103
2242899107,2cyclictest28457-21taskset20:25:303
2242899107,2cyclictest16843-21egrep20:05:183
2242899107,2cyclictest16843-21egrep20:05:183
2242899107,2cyclictest11327-21chrt19:50:533
2241899108,1cyclictest6947-21expr20:50:160
2241899108,1cyclictest17319-21fschecks_count20:05:200
2241899108,1cyclictest17319-21fschecks_count20:05:200
2241899107,2cyclictest9692-21egrep19:50:140
2241899107,2cyclictest641-21grep20:35:260
2241899107,2cyclictest4333-21sort00:35:180
2241899107,2cyclictest24269-21egrep23:30:150
224289997,1cyclictest2399-21basename19:35:113
224289997,1cyclictest22849-21wc19:10:143
224189996,2cyclictest27400-21tune2fs20:25:150
224189986,1cyclictest22614-21chrt19:10:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional