You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 04:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat Jul 27, 2024 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10234211095,10sleep20-21swapper/219:05:162
15005210995,10sleep30-21swapper/319:08:133
14267210995,10sleep10-21swapper/119:05:271
1531299108106,1cyclictest0-21swapper/219:18:092
153039910798,8cyclictest0-21swapper/019:18:100
14972210794,10sleep00-21swapper/019:07:460
153079910298,2cyclictest0-21swapper/119:18:101
33712880,1sleep3421rcuc/322:40:273
266522600,1sleep30-21swapper/320:10:293
15303995651,4cyclictest10335-21kworker/u16:1+events_unbound22:20:020
15312995149,1cyclictest0-21swapper/219:10:052
15303994840,8cyclictest0-21swapper/019:10:060
15307994540,2cyclictest0-21swapper/119:10:061
15303994037,2cyclictest23852-21kworker/u16:0+events_unbound21:20:000
15303993935,3cyclictest23852-21kworker/u16:0+events_unbound00:00:000
15312993328,4cyclictest23852-21kworker/u16:0+events_unbound21:20:032
15312993328,4cyclictest23852-21kworker/u16:0+events_unbound21:20:032
15303993228,3cyclictest23852-21kworker/u16:0+events_unbound22:55:020
15312993026,3cyclictest10335-21kworker/u16:1+events_unbound23:35:252
15307993026,3cyclictest23852-21kworker/u16:0+events_unbound22:45:291
15312992723,3cyclictest9536-21kworker/u16:3+events_unbound20:10:292
15312992723,3cyclictest23852-21kworker/u16:0+events_unbound23:20:282
15312992521,3cyclictest10335-21kworker/u16:1+events_unbound23:40:262
15312992521,3cyclictest10335-21kworker/u16:1+events_unbound22:05:302
15303992416,7cyclictest10086-21munin-run20:00:010
15307992313,9cyclictest15897-21turbostat21:30:011
15307992313,9cyclictest15897-21turbostat21:30:011
15307992118,2cyclictest535-21gdbus20:55:001
15307992113,7cyclictest0-21swapper/122:00:011
15303992113,7cyclictest28593-21apt20:44:590
15303992112,2cyclictest17248-21cron20:35:000
15303992111,2cyclictest32159-21unixbench_multi23:05:270
15312992016,3cyclictest10335-21kworker/u16:1+events_unbound21:25:512
15312992016,3cyclictest10335-21kworker/u16:1+events_unbound21:25:512
15303992017,2cyclictest0-21swapper/000:00:000
15303992012,2cyclictest24896-21idleruntime-cro21:10:000
15303992010,2cyclictest535-21gdbus20:40:000
15307991916,2cyclictest449-21apt21:45:001
15307991912,3cyclictest28842-21apt-get20:45:101
1530399199,3cyclictest27997-21fschecks_count21:40:150
1530799189,5cyclictest29654-21gltestperf22:10:141
1530799189,3cyclictest17205-21kthreadcore20:05:191
1530799189,2cyclictest13105-21unixbench_singl20:55:301
1530399188,2cyclictest22413-21unixbench_singl23:25:290
15303991814,3cyclictest1-21systemd23:04:590
15307991714,2cyclictest5953-21debian-sa120:25:001
15307991714,2cyclictest19210-21turbostat.cron21:05:001
1530399179,2cyclictest19758-21unixbench_multi00:20:270
1530399178,2cyclictest10468-21gltestperf22:50:140
1530399170,3cyclictest18384-21tr20:05:200
1530399170,11cyclictest25822-21df19:45:140
15312991612,3cyclictest23852-21kworker/u16:0+events_unbound23:15:212
15312991612,3cyclictest23852-21kworker/u16:0+events_unbound21:05:282
1530799166,2cyclictest0-21swapper/120:40:001
15307991613,2cyclictest24340-40mandb00:00:001
15303991613,2cyclictest4015-21apt19:55:010
15303991613,2cyclictest30697-21munin-run22:40:000
15303991613,2cyclictest25156-21cron19:45:010
15303991613,2cyclictest1698-21munin-run23:39:590
172112150,1sleep0181rcuc/023:25:000
15312991511,3cyclictest23852-21kworker/u16:0+events_unbound23:10:262
15312991511,3cyclictest22394-21grep23:25:282
15307991512,2cyclictest27016-21fschecks_count00:30:131
1530399157,1cyclictest26922cat19:25:010
15303991512,2cyclictest3920-21turbostat.cron22:45:000
15303991511,3cyclictest23852-21kworker/u16:0+events_unbound20:00:290
15312991411,2cyclictest9536-21kworker/u16:3+events_unbound19:25:182
15312991410,3cyclictest23852-21kworker/u16:0+events_unbound20:50:272
15312991410,3cyclictest23852-21kworker/u16:0+events_unbound19:40:272
15307991411,2cyclictest18432-21sed23:25:191
15307991411,2cyclictest17145-21cron23:25:001
15307991410,3cyclictest490-21dbus-daemon22:45:001
15307991410,3cyclictest31398-21avahi-daemon23:50:001
15307991410,3cyclictest31398-21avahi-daemon23:50:001
15303991411,2cyclictest17468-21wc22:00:010
303522130,0sleep20-21swapper/219:20:172
1531299139,3cyclictest25750-21grep00:25:272
1531299139,3cyclictest23852-21kworker/u16:0+events_unbound22:10:242
1531299139,3cyclictest23852-21kworker/u16:0+events_unbound00:30:252
1531299139,3cyclictest23852-21kworker/u16:0+events_unbound00:15:252
1531299130,12cyclictest18395-21missed_timers19:35:242
1530799139,3cyclictest1909-21latency_hist23:40:011
1530799139,2cyclictest0-21swapper/100:00:091
1530799138,4cyclictest0-21swapper/122:35:001
1530799136,6cyclictest0-21swapper/119:35:221
1530799131,11cyclictest23769-21df_inode22:05:181
15307991310,2cyclictest9912-21gpgv21:25:011
15307991310,2cyclictest9912-21gpgv21:25:001
15307991310,2cyclictest2515-21munin-run19:25:001
15307991310,2cyclictest0-21swapper/119:40:221
1530799130,3cyclictest20171-21hddtemp_smartct21:05:171
1530399139,3cyclictest956-21cut22:10:210
1530399139,3cyclictest7980-21grep20:25:190
15303991310,2cyclictest594-21cpuspeed23:10:130
15303991310,2cyclictest2982-21irqrtprio23:40:170
15303991310,2cyclictest11785-21idleruntime-cro21:55:000
15303991310,2cyclictest10165-21irqrtprio00:15:180
15303991310,2cyclictest0-21swapper/000:25:160
1531299128,3cyclictest23852-21kworker/u16:0+events_unbound20:55:012
1531299128,3cyclictest10335-21kworker/u16:1+events_unbound22:30:252
1531299120,11cyclictest25981-21cut21:35:222
1531299120,10cyclictest0-21swapper/221:30:132
1530799129,2cyclictest996-21cpuspeed_turbos21:45:111
1530799129,2cyclictest31300-21cpuspeed_turbos19:50:131
1530799129,2cyclictest30541-21cron21:14:591
1530799129,2cyclictest27896-21gltestperf23:05:151
1530799129,2cyclictest26838-21unixbench_singl21:35:291
1530799129,2cyclictest18901-21unixbench_multi22:25:321
1530799129,2cyclictest17250-21cron20:35:001
1530799129,2cyclictest17054-21irqcore21:30:291
1530799129,2cyclictest0-21swapper/123:10:151
1530799128,3cyclictest30948-21gltestperf00:05:161
1530799128,3cyclictest26073-21cut20:10:231
1530799128,3cyclictest15202-21cron22:55:001
1530799128,3cyclictest1-21systemd20:00:011
1530799120,11cyclictest8943-21latency_hist00:15:001
1530799120,11cyclictest25795-21grep00:25:281
1530399129,2cyclictest7778-21unixbench_singl19:25:300
1530399129,2cyclictest5671-21tail21:45:270
1530399129,2cyclictest528-21polkitd20:19:590
1530399129,2cyclictest31512-21unixbench_multi00:30:260
1530399129,2cyclictest2777-21fschecks_time22:15:140
1530399129,2cyclictest19871-21cpuspeed_turbos22:30:100
1530399129,2cyclictest14265-21ps23:50:170
1530399129,2cyclictest10560-21ntp_states23:15:250
1530399129,2cyclictest0-21swapper/022:00:210
1530399128,3cyclictest4075-21fschecks_time00:10:170
1530399128,3cyclictest14231-21fschecks_count21:00:190
1530399128,3cyclictest12517-21needreboot20:55:240
1530399121,3cyclictest7451-21apt-get20:54:590
1530399120,6cyclictest161rcu_preempt21:40:010
1530399120,11cyclictest0-21swapper/021:20:230
1530399120,11cyclictest0-21swapper/021:20:230
86032110,7sleep20-21swapper/200:11:252
1531299119,1cyclictest0-21swapper/222:20:002
1531299118,2cyclictest15237-21latency_hist22:54:592
1531299117,3cyclictest27895-21sed23:05:152
1531299117,3cyclictest10335-21kworker/u16:1+events_unbound21:15:272
1531299113,6cyclictest24240-21kthreadcore23:30:222
1531299112,7cyclictest19556-21cut20:35:202
1531299110,10cyclictest13935-21apt-get22:25:142
1530799118,2cyclictest8241-21gmain22:20:011
1530799118,2cyclictest271ktimers/122:35:201
1530799118,2cyclictest23726-21gltestperf23:30:181
1530799118,2cyclictest15313-21unixbench_multi20:00:291
1530799118,2cyclictest13505-21cpuspeed_turbos23:50:121
1530799118,2cyclictest11744-21sort00:15:191
1530799118,2cyclictest11020-21tail23:15:291
1530799118,2cyclictest0-21swapper/121:20:001
1530799118,2cyclictest0-21swapper/119:25:231
1530799117,4cyclictest271ktimers/119:45:111
1530799117,3cyclictest1-21systemd20:44:591
1530799110,2cyclictest1960-21apt-get23:40:101
1530799110,10cyclictest8409-21apt-get19:30:101
1530399118,2cyclictest5232-21cron00:39:590
1530399118,2cyclictest29118-21cpuspeed_turbos20:45:120
1530399118,2cyclictest23630-21cpuspeed_turbos22:05:170
1530399118,2cyclictest16814-21gltestperf21:30:230
1530399118,2cyclictest13798-21cron19:35:000
1530399117,3cyclictest0-21swapper/019:35:300
1530399113,7cyclictest26901-21cut21:10:190
1530399110,4cyclictest26728-21tr23:30:230
1530399110,10cyclictest0-21swapper/021:25:010
1530399110,10cyclictest0-21swapper/021:25:010
1531299107,2cyclictest28297-21kthreadcore19:45:202
1531299106,2cyclictest10554-21cut23:45:182
1531299106,2cyclictest10554-21cut23:45:182
1531299105,4cyclictest9536-21kworker/u16:3+events_unbound19:55:022
1531299104,5cyclictest535-21gdbus21:14:592
1531299104,5cyclictest535-21gdbus00:40:002
1531299103,6cyclictest0-21swapper/220:05:292
1531299102,6cyclictest1595-21cut20:20:192
1531299101,4cyclictest25982-21kthreadcore20:40:232
1531299100,8cyclictest7201-21sed20:25:182
1531299100,8cyclictest6688-21cstates21:50:142
1531299100,8cyclictest4814-21cut21:45:202
1531299100,8cyclictest30694-21cut20:15:222
1531299100,8cyclictest28893-21cut22:35:272
1531299100,8cyclictest24838-21tr00:00:142
1531299100,8cyclictest20237-21basename00:25:002
1531299100,8cyclictest10934-21cut19:30:212
1531299100,5cyclictest32185-21cut19:50:182
1531299100,10cyclictest0-21swapper/221:55:202
1530799108,2cyclictest0-21swapper/122:05:011
1530799108,1cyclictest0-21swapper/100:35:191
1530799107,2cyclictest2886-21gltestperf22:15:141
1530799107,2cyclictest21998-21fschecks_count23:00:151
1530799107,2cyclictest20209-21cron00:25:001
1530799107,2cyclictest11095-21switchtime21:50:291
1530799104,4cyclictest6665-21fschecks_count20:25:151
1530799100,9cyclictest0-21swapper/122:55:001
1530799100,8cyclictest27375-21cut20:15:131
1530399107,2cyclictest18919-21unixbench_multi22:25:320
1530399107,2cyclictest0-21swapper/000:05:150
1530399106,3cyclictest12993-21cron23:50:000
1530399106,3cyclictest12993-21cron23:50:000
1530399101,3cyclictest4484-21cstates22:45:140
1530399100,2cyclictest0-21swapper/020:20:140
153129996,2cyclictest0-21swapper/220:00:202
153129995,3cyclictest23852-21kworker/u16:0+events_unbound22:40:152
153129994,4cyclictest17690-21apt22:00:112
153129994,4cyclictest14430-21grep21:00:202
153129993,5cyclictest31791-21kthreadcore00:05:202
153129990,8cyclictest5382-21cut22:45:192
153129990,8cyclictest32308-21cut20:45:202
153129990,8cyclictest30059-21cut21:40:192
153129990,8cyclictest23613-21cut23:00:212
153129990,8cyclictest13522-21tr23:50:122
153129990,8cyclictest12872-21irqrtprio20:30:192
153129990,4cyclictest10431-21cut22:20:182
153039990,8cyclictest22175-21fschecks_count20:10:140
153129985,2cyclictest0-21swapper/222:55:152
153129980,7cyclictest20018-21irqrtprio23:55:202
13667280,2sleep30-21swapper/322:25:013
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
8270270,2sleep30-21swapper/322:20:123
15847270,5sleep30-21swapper/322:55:023
14419271,5sleep30-21swapper/300:18:353
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
9958260,4sleep30-21swapper/320:55:233
3078260,2sleep30-21swapper/300:07:573
29226260,2sleep30-21swapper/319:19:313
28980260,4sleep30-21swapper/322:10:093
28460260,2sleep30-21swapper/320:43:293
28385260,3sleep30-21swapper/323:34:183
24584260,2sleep30-21swapper/321:06:163
21545260,4sleep30-21swapper/323:00:123
17497260,4sleep30-21swapper/320:35:103
14925260,2sleep30-21swapper/322:51:293
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
9939250,4sleep30-21swapper/319:58:273
9331250,4sleep30-21swapper/322:47:083
8687250,3sleep30-21swapper/321:20:203
8687250,3sleep30-21swapper/321:20:203
7902250,4sleep30-21swapper/300:10:253
7510250,2sleep30-21swapper/322:18:583
6506250,3sleep30-21swapper/323:15:143
32225250,3sleep30-21swapper/300:35:103
29548250,4sleep30-21swapper/319:20:113
28698250,3sleep30-21swapper/323:35:103
22746250,4sleep30-21swapper/323:29:243
21375250,2sleep30-21swapper/321:32:213
20206250,2sleep30-21swapper/300:25:003
19751250,3sleep30-21swapper/319:40:123
17000250,2sleep30-21swapper/320:31:533
15756250,3sleep30-21swapper/320:05:013
15535250,3sleep30-21swapper/319:10:013
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
none08:51:274
7399240,3sleep30-21swapper/320:54:313
7339240,2sleep30-21swapper/323:44:563
6118240,2sleep30-21swapper/321:50:023
5939240,2sleep30-21swapper/320:25:003
3735240,2sleep30-21swapper/321:19:563
32500240,3sleep30-21swapper/323:08:333
32386240,3sleep30-21swapper/320:15:513
32189240,2sleep30-21swapper/321:40:283
28580240,2sleep30-21swapper/320:45:013
27370240,2sleep30-21swapper/300:30:173
27161240,3sleep30-21swapper/321:39:073
26934240,2sleep30-21swapper/322:35:273
26177240,3sleep30-21swapper/300:28:483
25099240,3sleep30-21swapper/321:10:013
23075240,2sleep30-21swapper/322:04:573
20631240,2sleep30-21swapper/323:55:223
20546240,2sleep30-21swapper/322:30:183
19466240,2sleep30-21swapper/319:39:563
15529240,3sleep30-21swapper/320:02:033
13637240,3sleep30-21swapper/319:32:593
12269240,2sleep30-21swapper/323:45:243
12269240,2sleep30-21swapper/323:45:243
11863240,2sleep30-21swapper/323:20:143
10906240,2sleep30-21swapper/321:25:293
10906240,2sleep30-21swapper/321:25:293
712230,2sleep30-21swapper/321:45:053
537230,2sleep30-21swapper/320:20:083
311230,2sleep30-21swapper/323:10:013
30824230,2sleep30-21swapper/319:50:013
2751230,2sleep30-21swapper/319:25:053
25395230,2sleep30-21swapper/319:45:043
24584230,2sleep30-21swapper/300:00:073
23336230,2sleep30-21swapper/322:05:083
13771230,2sleep30-21swapper/321:00:083
12991230,1sleep30-21swapper/323:50:003
12002230,2sleep30-21swapper/321:55:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional