Few Videos are repeating again

Question

Hi

Few Videos are repeating again & there are 428 Short Videos it is displaying 403

protected void MyOwnVideos11()

        {
            StringBuilder htmlTable = new StringBuilder();
            string nextPageToken = string.Empty;
            Int32 Sr = 1;
            var data0 = GetVideosList(nextPageToken);
            var orderByPublishAt = data0.items.OrderBy(x => x.snippet.publishedAt);

            htmlTable.Append("<table class='table table-bordered table-hover datatable-highlight' id='tbldata'>");
            htmlTable.Append("<thead><tr><th>Sr.</th><th>Video Id</th><th>Video Title</th><th>Description</th</tr></thead>");
            htmlTable.Append("<tbody>");

            nextPageToken = data0.nextPageToken;
            while (!string.IsNullOrEmpty(nextPageToken))
            {
                data0 = GetVideosList(nextPageToken);
                orderByPublishAt = data0.items.OrderBy(x => x.snippet.publishedAt);
                nextPageToken = data0.nextPageToken;
                foreach (var data in orderByPublishAt)
                {
                    var clientTag = new RestClient("googleapis.com/youtube/v3/");
                    var tagRequest = new RestRequest("videos", Method.GET);
                    tagRequest.AddParameter("key", "AG8");
                    tagRequest.AddParameter("part", "snippet,statistics");
                    tagRequest.AddParameter("id", data.id.videoId);
                    var tagResponse = clientTag.Execute<VideoListResponse>(tagRequest);

                    foreach (var item in tagResponse.Data.items)
                    {
                        htmlTable.Append("<td >" + Sr + "</td>");
                        htmlTable.Append("<td></td>");
                        htmlTable.Append("<td >" + item.snippet.title + "</td>");
                        htmlTable.Append("<td >" + item.snippet.description + "</td>");

                        
                        htmlTable.Append("</tr>");
                        Sr = Sr + 1;
                    }
                }
            }
            htmlTable.Append("</tbody>");
            htmlTable.Append("</table>");
            PlaceHolderTable.Controls.Add(new Literal { Text = htmlTable.ToString() });
        }

---------------------------------------------------------------------

private static YoutubeSearchListResponse GetVideosList(string nextPageToken)
 {
 var client = new RestClient("googleapis.com/youtube/v3");
 var request = new RestRequest("search", Method.GET);
 request.AddParameter("part", "snippet");
 request.AddParameter("type", "video");
 request.AddParameter("channelId", "UVw");
 request.AddParameter("key", "AG8");
 if (!string.IsNullOrEmpty(nextPageToken))
 {
 request.AddParameter("pageToken", nextPageToken);
 }
 var response = client.Execute<YoutubeSearchListResponse>(request);

 return response.Data;
 }

Thanks

Tuhin Paul · Answer

After applying the fixes, the output should: Display 428 unique videos without any duplicates. Include all required columns ( Sr. , Video Id , Video Title , Description ).

Tuhin Paul · Answer

Part 3: Explanation of Changes Duplicate Filtering : A HashSet named uniqueVideoIds is used to store unique video IDs. Before processing a video, its ID is checked against the HashSet . If the ID already exists, the video is skipped. Pagination Logic : The do-while loop ensures that all pages are processed until nextPageToken becomes null . The nextPageToken is updated after each iteration, and the loop fetches the next page of videos. HTML Table Structure : Fixed the missing tag in the HTML table rows. Added the Video Id column to display the unique video ID.

Tuhin Paul · Answer

Part 2: Below is the corrected version of your code with the necessary fixes: protected void MyOwnVideos11() { StringBuilder htmlTable = new StringBuilder(); string nextPageToken = string.Empty; Int32 Sr = 1; // HashSet to track unique video IDs HashSet uniqueVideoIds = new HashSet (); // Fetch the first page of videos var data0 = GetVideosList(nextPageToken); var orderByPublishAt = data0.items.OrderBy(x => x.snippet.publishedAt); htmlTable.Append(" "); htmlTable.Append(" Sr. Video Id Video Title Description "); htmlTable.Append(" "); do { foreach (var data in orderByPublishAt) { // Skip duplicate video IDs if (!uniqueVideoIds.Add(data.id.videoId)) continue; var clientTag = new RestClient("https://googleapis.com/youtube/v3/"); var tagRequest = new RestRequest("videos", Method.GET); tagRequest.AddParameter("key", "AG8"); tagRequest.AddParameter("part", "snippet,statistics"); tagRequest.AddParameter("id", data.id.videoId); var tagResponse = clientTag.Execute (tagRequest); foreach (var item in tagResponse.Data.items) { htmlTable.Append(" "); htmlTable.Append(" " + Sr + " "); htmlTable.Append(" " + item.id + " "); htmlTable.Append(" " + item.snippet.title + " "); htmlTable.Append(" " + item.snippet.description + " "); htmlTable.Append(" "); Sr++; } } // Update nextPageToken and fetch the next page nextPageToken = data0.nextPageToken; if (!string.IsNullOrEmpty(nextPageToken)) { data0 = GetVideosList(nextPageToken); orderByPublishAt = data0.items.OrderBy(x => x.snippet.publishedAt); } } while (!string.IsNullOrEmpty(nextPageToken)); htmlTable.Append(" "); htmlTable.Append(" "); PlaceHolderTable.Controls.Add(new Literal { Text = htmlTable.ToString() }); }

Tuhin Paul · Answer

Part 1: Root Causes and Solutions 1. Repeating Videos The YouTube API's search.list endpoint may return duplicate video entries across different pages if the query parameters are not properly constrained. To address this: Filter Duplicates : Use a HashSet to track unique video IDs and ensure no duplicates are added to the table. Check Data Source : Verify that the data0.items collection does not already contain duplicates before processing. 2. Incorrect Video Count The pagination logic might not be iterating through all pages correctly. This could happen if: The nextPageToken is not updated properly. The loop terminates prematurely due to an empty or null nextPageToken . To fix this: Ensure the while loop continues until nextPageToken becomes null . Validate the API response to confirm that all pages are being fetched.